-- Logs begin at Thu 2022-05-19 11:16:47 UTC, end at Thu 2022-05-19 12:40:45 UTC. -- May 19 11:56:04.957054 dv-cinder-778193-27-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 11:56:04.965719 dv-cinder-778193-27-smb devstack@keystone.service[80586]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 11:56:04 2022] *** May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: nodename: dv-cinder-778193-27-smb May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: machine: x86_64 May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: clock source: unix May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: pcre jit disabled May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: detected number of CPU cores: 4 May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: current working directory: / May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: detected binary path: /usr/bin/uwsgi-core May 19 11:56:04.967926 dv-cinder-778193-27-smb devstack@keystone.service[80586]: your processes number limit is 47680 May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: your memory page size is 4096 bytes May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: detected max file descriptor number: 2048 May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: lock engine: pthread robust mutexes May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: thunder lock: enabled May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 11:56:04.968656 dv-cinder-778193-27-smb devstack@keystone.service[80586]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 11:56:05.014254 dv-cinder-778193-27-smb devstack@keystone.service[80586]: Python main interpreter initialized at 0x55ce303b59c0 May 19 11:56:05.014254 dv-cinder-778193-27-smb devstack@keystone.service[80586]: python threads support enabled May 19 11:56:05.014254 dv-cinder-778193-27-smb devstack@keystone.service[80586]: your server socket listen backlog is limited to 100 connections May 19 11:56:05.014254 dv-cinder-778193-27-smb devstack@keystone.service[80586]: your mercy for graceful operations on workers is 90 seconds May 19 11:56:05.014632 dv-cinder-778193-27-smb devstack@keystone.service[80586]: mapped 403077 bytes (393 KB) for 2 cores May 19 11:56:05.014709 dv-cinder-778193-27-smb devstack@keystone.service[80586]: *** Operational MODE: preforking *** May 19 11:56:05.014964 dv-cinder-778193-27-smb devstack@keystone.service[80586]: *** uWSGI is running in multiple interpreter mode *** May 19 11:56:05.014964 dv-cinder-778193-27-smb devstack@keystone.service[80586]: spawned uWSGI master process (pid: 80586) May 19 11:56:05.015174 dv-cinder-778193-27-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 11:56:05.015734 dv-cinder-778193-27-smb devstack@keystone.service[80586]: spawned uWSGI worker 1 (pid: 80601, cores: 1) May 19 11:56:05.016610 dv-cinder-778193-27-smb devstack@keystone.service[80586]: spawned uWSGI worker 2 (pid: 80602, cores: 1) May 19 11:56:05.017366 dv-cinder-778193-27-smb devstack@keystone.service[80586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 11:56:10.720289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:56:10.720289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: from cryptography.utils import int_from_bytes May 19 11:56:10.721036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:56:10.721036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: from cryptography.utils import int_from_bytes May 19 11:56:10.721147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:56:10.721147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: from cryptography.utils import int_from_bytes May 19 11:56:10.721147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:56:10.721147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: from cryptography.utils import int_from_bytes May 19 11:56:10.769829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:56:10.770021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:56:10.770109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:56:10.770195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] command line args: [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:56:10.770275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:56:10.770463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:56:10.770547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] command line args: [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:56:10.770623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ================================================================================ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:56:10.770731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:56:10.770876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] admin_token = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.770960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ================================================================================ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:56:10.771120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_dir = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] admin_token = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_dir = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] config_source = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] debug = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] config_source = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.771852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] debug = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.772998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_config_append = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_config_append = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_dir = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_dir = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.773988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.774935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.775951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.776894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.777490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.777663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.777745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.777940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] publish_errors = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] publish_errors = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.778912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] standard_threads = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.779999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] standard_threads = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_journal = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_json = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_journal = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_stderr = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.780926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_json = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] use_syslog = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_stderr = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] use_syslog = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:56:10.781603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.781680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.781836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.781912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.782886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.783844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.784990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.785960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.786932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.787957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.788904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.789980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.790992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.791984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.792965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.793970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.794879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.795955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.796974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.797928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.798874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.799968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.800989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.801953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.802893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.803967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.804994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.805995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.external = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.external = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.806983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.password = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.password = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] auth.token = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] auth.token = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.807982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.808988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.809855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.810895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.811866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.812922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.813866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.814971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.815930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.816983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.817913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.818858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.819961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.820972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.821963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.822908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.823055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.823140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.823298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.823374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.823536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.824897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.825962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.826979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.827912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.828877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.829969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830447 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.830983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.831884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.832868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.833947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.834963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.835917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.836866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.837954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.838989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.839142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.839217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.839955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.840992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.841941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.842905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.843847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.844973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.845944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.846899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.847993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.848943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.849961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.850903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.851991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.852949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.853954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.854980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.855914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.856874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:56:10.857869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:56:10.857939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:56:10.889310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.889458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.889532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.889604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.889742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.889843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.898426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.898511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.926613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.926867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.926991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.927122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.987821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:10.988268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.039395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.039555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.039641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.039719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.104541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.104767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.105908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.106028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.106143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.106224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.130924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.131550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.143475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.143822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.158981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.159225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.159449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.159667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.159804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.159903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.160074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.160159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.160330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.160569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.160828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.161091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.161350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.161569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:56:11.180012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.180293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:56:11.180631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.180829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:56:11.181093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.181347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.181595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.181722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.181839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.181922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:56:11.182249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.182442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:56:11.182705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.182994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.183251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.183500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.192870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.193139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.193400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.193674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.194798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.195068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.195327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.195595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.201761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.203744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.205020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.205293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.205675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.205952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.206230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.206482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.206742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.207268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.207895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.208164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.208442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.208702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.208966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.209226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.209488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.209750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.236455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.237482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.238104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.238344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.239078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.239351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.243613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.243883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.244163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.244616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.244889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.245159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.251554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.251892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.252629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.252901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.256623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.256932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.257208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.257482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.257579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.257749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.257834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.258846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.259109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.259367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.278413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.278684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.279916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.280233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.283435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.284931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.287041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.287327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.288704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.291742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.292378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.294325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.295910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.298000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.299759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.300081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.300417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.300733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.301059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.301351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.301929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.302249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.302550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.302865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.303167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.303456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.321932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.322320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.322583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.322847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.324962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.325437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.325732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.325997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.331275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.333017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.333322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.334096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.335803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.336081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.336413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.336689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.336971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.337272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.337544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.339286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.340057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.340351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.340628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.340892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.351456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.351731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.352003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.352306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.352580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.352845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.353119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.354410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.354697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.354993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.355273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.355552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.355819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.356092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.371107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.374293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.374390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.377519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.377648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.379222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.380816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.380907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.381140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.381417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.382390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.384001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.384314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.384589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.389378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.390974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.392600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.394192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.394275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.394474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.394746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.395009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.397397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.397678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.397954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.398220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.404872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.405179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.405451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.407957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.408327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.408673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.413265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.413545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.413817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.414088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.414358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.414619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.414890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.415148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.415423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.415683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.415950 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.416228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.416491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.416571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:56:11.416744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.416837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.417029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.417319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.417642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.417912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.418177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.418433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.418711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.418969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.419234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.419485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.419751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.420006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:56:11.455989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce303b59c0 pid: 80602 (default app) May 19 11:56:11.459147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce303b59c0 pid: 80601 (default app) May 19 11:56:11.459302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9afc-276a-4808-bba7-fdcafd7a2e7f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.459592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9afc-276a-4808-bba7-fdcafd7a2e7f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.459873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9afc-276a-4808-bba7-fdcafd7a2e7f None None] PATH_INFO: `/v3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.464017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.679610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.680139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.680139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.684940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:20.689885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.690310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.690409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.757609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: INFO dbcounter [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] Registered counter for database keystone May 19 11:56:20.779480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG oslo_db.sqlalchemy.engines [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:56:20.785719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writer thread running {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:56:20.961556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG passlib.handlers.bcrypt [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80602) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:56:20.961899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG passlib.handlers.bcrypt [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80602) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:56:21.016962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:21.018534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:21.140824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 11:56:21.307194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.376400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: INFO dbcounter [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] Registered counter for database keystone May 19 11:56:21.396077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG oslo_db.sqlalchemy.engines [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:56:21.402249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writer thread running {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:56:21.519145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcefc94-7c7f-4177-ac07-5786ced632ea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.523338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.523989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.524297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.524569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.532684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.583556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:56:21.583841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5397d-0368-46a2-8391-e809cb38cad1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.593279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 11:56:21.599324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.613629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384c33-0366-4949-bcb6-ef7d8dd30fa8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.617935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.619027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.619306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.619606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] PATH_INFO: `/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.621596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] RBAC: Authorizing `identity:get_project(project_id=ae3e54b6083e4b39ac3a5ef049d34d8c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.778959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:56:21.779607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948b403-798e-44b1-991c-a48fdbc1b98e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.783908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:23.945115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69643e-89ae-482c-95cb-88fd58d3c55c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.945622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69643e-89ae-482c-95cb-88fd58d3c55c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.945774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69643e-89ae-482c-95cb-88fd58d3c55c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.949807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:23.955594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.956002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.956145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.974991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:23.976505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:23.984762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 11:56:24.006421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69643e-89ae-482c-95cb-88fd58d3c55c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.018583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69643e-89ae-482c-95cb-88fd58d3c55c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:24.022721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:24.023339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.023618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.023888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.031996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:24.033773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba656c8-499f-4211-8df6-3e79856b8251 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:24.042283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 11:56:24.047384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.056535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a344-1ce4-41b9-872c-195cecf4745e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:24.060860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:24.061708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.061989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.062262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.063631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:24.065476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099119b3-8cf5-4a70-8144-b68427f8da88 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:24.067013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:26.333737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e235d0-8b48-414c-8295-9513c23a6269 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.334267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e235d0-8b48-414c-8295-9513c23a6269 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.334267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e235d0-8b48-414c-8295-9513c23a6269 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.335879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:26.341757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9fc7b-54b9-47e9-8f34-62831dbad96e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.342169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.342271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9fc7b-54b9-47e9-8f34-62831dbad96e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.342352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9fc7b-54b9-47e9-8f34-62831dbad96e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.342426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.342579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.343641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:26.348587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.348875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.349177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.365146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:26.366334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:26.380823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG passlib.handlers.bcrypt [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:56:26.381234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG passlib.handlers.bcrypt [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:56:26.427971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:26.429803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:26.444099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:26.466455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.489743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.529628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 6/13] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:26.552648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.569880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f840e6-4aa0-4ad4-bc55-413138ae1984 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.606165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.606745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.607026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.607299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.677039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.679004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.703465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.759815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7020c3-d060-4019-b930-6ab690cd7096 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.762158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.777975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 8/14] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:56:26.783017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.796278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.797320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.797604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.797972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.810664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:26.821673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:26.823375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:26.824191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 7/15] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:26.830756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.879594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ade9-1208-47e3-9ea0-c70df33010c9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.901539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.912847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.917997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.917997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.917997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.924784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.926261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.927406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58e35-b3b9-444d-8a95-68b6fc518768 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:26.948778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:26.949775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:26.950785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:26.950785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:26.950785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:26.950785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:26.950785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 9/16] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:26.955877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.964421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.965091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.965375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.965651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.966395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:26.966705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.968126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.980297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:26.985637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.012286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.056935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa36c-786d-454a-bf1d-487b094953a8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.084448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2fe0-0523-4cf1-bffe-0ffb0ead8192 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.089537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.090179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.090488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.090761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.091466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:27.091765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.093175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.110460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:27.118470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.119364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.120242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.120530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.122204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.123701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.125472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:27.131245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.167991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.237740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e757-20ef-4260-a9f3-a431d6833743 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.284325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.284540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.284713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.284925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.286123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.287631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed50a1-8d52-4d91-b72b-8015cd31dbfe None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.289236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:27.295454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.394780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.402871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b890-0127-4767-8431-8fcbdf68ea37 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.438619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.439282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.439558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.439826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.440705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.domain.id=default, user.id=d15f9567be7a45d68d8b1259f6bb9e07) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:27.441012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.442454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82c587-6186-45cf-8418-4a07e6f60227 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.451432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/role_assignments?user.id=d15f9567be7a45d68d8b1259f6bb9e07&scope.domain.id=default&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:29.777767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407393-f814-4e60-9ad8-b2cb1732614c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.778675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407393-f814-4e60-9ad8-b2cb1732614c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.779152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407393-f814-4e60-9ad8-b2cb1732614c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.780737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:29.790355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.790809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.790883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.801426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa33e-69cb-4d5f-87d6-4baf18f37426 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.801968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa33e-69cb-4d5f-87d6-4baf18f37426 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.802417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa33e-69cb-4d5f-87d6-4baf18f37426 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.804256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 13/23] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:29.825948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.826497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.826946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.828042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:29.829462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:29.865312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:29.866837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:29.969737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 11/24] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:30.010762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.017599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 11:56:30.065865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.140511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.160558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.179899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4946f8-5c20-4d43-afad-b44adc6f1a32 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.242477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.243709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.244223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.248633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.276192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.278036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.284086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313078-7e51-47c3-ab9a-80d594b7107c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:30.311160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:30.314244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:30.315045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:30.315045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:30.315045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:30.315045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:30.319404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 12/26] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:30.333276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.344920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.345606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.345887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.346150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.346918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.348325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9b58-b79b-4c03-a194-a19a2a08dc5d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.499128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93923fdf-654f-441e-9cb9-c3bedc79d0a1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.581490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.582083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.582361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.582631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.583354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:30.583651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.585086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55195872-408d-436e-afbd-5c7b8a4c66c1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.601416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 15/27] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/roles => generated 219 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:30.602542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.603988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22513c-f5e0-4c35-baa2-ab415707fe08 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.604463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22513c-f5e0-4c35-baa2-ab415707fe08 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.604907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22513c-f5e0-4c35-baa2-ab415707fe08 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.606728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 16/28] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:30.607705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 13/29] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:30.609646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c8f9-011d-47de-b191-63dae3508736 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.610175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c8f9-011d-47de-b191-63dae3508736 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.610622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c8f9-011d-47de-b191-63dae3508736 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.617675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 14/30] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:30.617808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a544313-15fa-4388-850d-e47793a7ec96 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.617808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a544313-15fa-4388-850d-e47793a7ec96 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.617808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a544313-15fa-4388-850d-e47793a7ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.617986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362c8f9-011d-47de-b191-63dae3508736 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.653478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4a544313-15fa-4388-850d-e47793a7ec96 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:30.655039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a544313-15fa-4388-850d-e47793a7ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:30.764124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362c8f9-011d-47de-b191-63dae3508736 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.803849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.804593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.804814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.805086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.805966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.808504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.838758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 17/31] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:30.841045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.841597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.842109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.860009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:30.861739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:30.880587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.941189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 18/32] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:30.942166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.069834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427ddaa-489b-4857-8219-8147fe9f039e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.071468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 15/33] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/projects => generated 301 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:31.072754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.111614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.112830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.113306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.113769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.127530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:31.132020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4c52ec4e-e996-4a7a-8f17-25209727d813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:31.139138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:31.140025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:31.140822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:31.143600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 19/34] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:31.146036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddaac-79ae-46d8-a31b-83f991aa1e5e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.146511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddaac-79ae-46d8-a31b-83f991aa1e5e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.146942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddaac-79ae-46d8-a31b-83f991aa1e5e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.152403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 20/35] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:31.154901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bddaac-79ae-46d8-a31b-83f991aa1e5e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.174063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.192356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806428b6-005c-4e1b-bf57-0e28da1aaad7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.233646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.234336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.234622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.234900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.235684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.237431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.283246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bddaac-79ae-46d8-a31b-83f991aa1e5e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.325253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.325957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.326272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.326554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.327393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:31.327708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.329288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1f9b6-c4c1-4d5f-a15d-aebee6270b04 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.342998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 21/36] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:31.344425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581081-0ec3-4072-ab14-dbc82fe69ae5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.344712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581081-0ec3-4072-ab14-dbc82fe69ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.344992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581081-0ec3-4072-ab14-dbc82fe69ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.361612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b5581081-0ec3-4072-ab14-dbc82fe69ae5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:31.362847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b5581081-0ec3-4072-ab14-dbc82fe69ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:31.377612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 16/37] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:31.379206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.464687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 22/38] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:31.466423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8be3-5acd-4635-a9f7-0f8ee9a2e546 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.466943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8be3-5acd-4635-a9f7-0f8ee9a2e546 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.467416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8be3-5acd-4635-a9f7-0f8ee9a2e546 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.469023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 23/39] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:31.474642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.475229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.475715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.483486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.495516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:31.496817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:31.510909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed447-3e52-4c01-9679-dd92046f51b0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.524996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.548271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.549819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.550615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.551063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.552524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.554233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.560260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 17/40] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:31.560260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.580585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 24/41] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:31.581277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.668766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a0435-8a1b-45f7-9d13-14db7fd19e4a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.690994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d511f6-629a-4b50-8afd-e4b6aea90344 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.701276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.701940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.702225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.702507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.703244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.704671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.724908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.725691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.725970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.726243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.727552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.731478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.731478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 25/42] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:31.732064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.734515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.826296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a755e-fd56-4dab-b79d-0d42eed524ad None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.829261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 18/43] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/roles => generated 223 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:31.830103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.865692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.866616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.866900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.867174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.868507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.870277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.871986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 26/44] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:31.877683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.901818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.957252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.969418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724194-65b2-41e8-8878-0be2195f0467 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.989620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40b95-66ec-4693-aeb7-9f47d249c731 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.008592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.009480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.009769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.010169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] PATH_INFO: `/v3/domains/default/users/d15f9567be7a45d68d8b1259f6bb9e07/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.012403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d15f9567be7a45d68d8b1259f6bb9e07, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.014580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7ba3-aef5-4397-ab90-23ffc7fbcd60 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.028491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.032581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.032581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.032581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.032581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.032581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e88e9-dd7a-470c-890f-a68addd0b094 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.085883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 19/45] 10.222.0.60 () {58 vars in 1361 bytes} [Thu May 19 11:56:31 2022] PUT /identity/v3/domains/default/users/d15f9567be7a45d68d8b1259f6bb9e07/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:32.122210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 27/46] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:34.274664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc912-30fa-41ff-befd-6605ad83071a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.275206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc912-30fa-41ff-befd-6605ad83071a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.275206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc912-30fa-41ff-befd-6605ad83071a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.277158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 20/47] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:34.282399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.282795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.282960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.300273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:34.301460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:34.349283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac52f7-0b16-49e8-906e-7daf8d883333 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.349571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac52f7-0b16-49e8-906e-7daf8d883333 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.349849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac52f7-0b16-49e8-906e-7daf8d883333 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.351210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 21/48] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:34.356833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6307-99f3-415d-abba-0a58217df54f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.357124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6307-99f3-415d-abba-0a58217df54f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.357407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6307-99f3-415d-abba-0a58217df54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.369454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 28/49] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:34.374436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-713f6307-99f3-415d-abba-0a58217df54f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:34.376005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-713f6307-99f3-415d-abba-0a58217df54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:34.392118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.443243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 22/50] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:34.444251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.467548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6307-99f3-415d-abba-0a58217df54f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.491181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c5113-996b-47d6-a221-e2cea5aad037 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.497598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.525444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.526703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.526989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.527287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.538841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:34.547406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:34.549800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:34.550809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 29/51] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:34.554777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.568396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6307-99f3-415d-abba-0a58217df54f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.602511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.603304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.603637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.603915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.605159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.607757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.609451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 23/52] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:34.615543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.658423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313e67-a56b-4687-bd64-2baedc014b50 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.671215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.691858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.692568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.692853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.693169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.693870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:34.694177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.695580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.703851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 30/53] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:34.709284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.716355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.719260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9be0-73a0-4564-82f6-1bbf45d78eaa None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.752848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.753517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.753804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.754092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.754800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.756288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.805718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97658d77-a3b5-4f72-9370-112a835d7d83 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.838928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.839822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.840103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.840408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.841599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.843051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.844675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 31/54] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:34.849854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.876234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 24/55] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 19 11:56:34 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:34.894252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.955546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323771-87f6-492f-b19c-244f1a92b50f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.991062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.991866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.992147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.992471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.993694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.995157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da834d8-f391-43ce-85d5-7e6e051ffd5a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.996835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 32/56] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:35.002731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:35.105510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e70a2-312b-4fbc-82df-8cd664c1cc3d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:35.137141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:35.137796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.138081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.138360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.139185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.domain.id=default, user.id=d15f9567be7a45d68d8b1259f6bb9e07) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:35.139498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:35.140977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd29f4-8763-47c9-a39f-06e847c8e54f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:35.146661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 25/57] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 19 11:56:35 2022] GET /identity/v3/role_assignments?user.id=d15f9567be7a45d68d8b1259f6bb9e07&scope.domain.id=default&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:37.085338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce409-7515-4488-a0a9-365208a2e708 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.085861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce409-7515-4488-a0a9-365208a2e708 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.085861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce409-7515-4488-a0a9-365208a2e708 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.087264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 33/58] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:37.093046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.093479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.093613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.109870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:37.111058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:37.120420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.174288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 26/59] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:37.199970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce409-7515-4488-a0a9-365208a2e708 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:37.298185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce409-7515-4488-a0a9-365208a2e708 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:37.309490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.332763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:37.333543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.333825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.334121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.335410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:37.336849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28834e35-a767-49c1-950c-855d2a0248a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:37.338486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 34/60] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:37.343869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:37.439743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fdd4-d0ae-4e97-9800-a387d5122770 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:37.472426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:37.473082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.473366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.473640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.474344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:37.475773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713340df-7abc-4a67-b00d-ccd2fddc0075 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:37.607237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.611703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 27/61] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:56:37 2022] POST /identity/v3/users => generated 275 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:40.747785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cca2a-5aef-44fc-9e8e-7dcbe29f042d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.748319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cca2a-5aef-44fc-9e8e-7dcbe29f042d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.748497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cca2a-5aef-44fc-9e8e-7dcbe29f042d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.749928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 35/62] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:40.765952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7d68-e4bd-4c67-ab2d-27d10e046558 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.766433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7d68-e4bd-4c67-ab2d-27d10e046558 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.766504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7d68-e4bd-4c67-ab2d-27d10e046558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.786423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-619c7d68-e4bd-4c67-ab2d-27d10e046558 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:40.787615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-619c7d68-e4bd-4c67-ab2d-27d10e046558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:40.885529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 28/63] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:40.920906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cca2a-5aef-44fc-9e8e-7dcbe29f042d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.065923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cca2a-5aef-44fc-9e8e-7dcbe29f042d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.066969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d3f7-e45b-47a9-b15d-43f672bbe213 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.067489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d3f7-e45b-47a9-b15d-43f672bbe213 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.067964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d3f7-e45b-47a9-b15d-43f672bbe213 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.069595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 29/64] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:41.075365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.075887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.076404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.096242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:41.106354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:41.138991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.140173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.140736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.141213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.167320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:41.175390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:41.176255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:41.177027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:41.184338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 36/65] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:41.194074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.246235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 30/66] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:41.266942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.285069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.378954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536bdef-0d2a-41c5-a868-f2dfdffaae2c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.394374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.420754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.421663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.422095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.422586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.423528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:41.424057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:41.425683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68247371-adab-40f2-be73-d08e1db46146 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:41.436783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 37/67] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:41.439256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904e20d-2976-4289-a4c8-89309b012ebf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.440109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eebd9d-8a89-45ae-a6cf-4cbc743a0489 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.440595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eebd9d-8a89-45ae-a6cf-4cbc743a0489 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.441003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eebd9d-8a89-45ae-a6cf-4cbc743a0489 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.442752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 38/68] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:41.444049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5208e-f840-4555-858a-04cf617666fc None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.444539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5208e-f840-4555-858a-04cf617666fc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.444963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5208e-f840-4555-858a-04cf617666fc None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.450857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 39/69] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:41.450857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5208e-f840-4555-858a-04cf617666fc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.473906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.474703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.474988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.475267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.486165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e83f879c-7922-41e2-a093-9f5969b0823d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:41.493856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:41.494709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:41.495502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 31/70] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:41.497100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0132-d7ce-4560-8dd8-198266d461b7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.497100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0132-d7ce-4560-8dd8-198266d461b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.497100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a0132-d7ce-4560-8dd8-198266d461b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.514191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8d6a0132-d7ce-4560-8dd8-198266d461b7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:41.515380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8d6a0132-d7ce-4560-8dd8-198266d461b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:41.559625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.564250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5208e-f840-4555-858a-04cf617666fc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.590757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 32/71] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:41.592006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.592311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.592592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.609829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.611119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.611560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.611990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.617094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:41.618281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:41.626149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:41.627721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:41.630375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 40/72] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:41.633046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.671270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.693578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 33/73] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:41.694650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.747833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d081-a60a-448b-a73b-7d0ec4cf4d43 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.784146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.784849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.785132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.785414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.786214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:41.786521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:41.787900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:41.796416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 41/74] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:41.797242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.804176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b49c-36a3-4d3c-a42e-45570fe2174c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.819805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.836637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.837951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.838248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.838522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.848508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:41.857251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:41.858097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 34/75] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:41.863635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:41.897417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ccba4-4ceb-46e8-a5a8-4f89002c1178 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.902739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:41.932309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.932954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.933238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.933509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.959178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3fbde-6f84-428f-8b36-d5b9e960b9d3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:41.991948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:41.992759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:41.993042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:41.993313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:41.998120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:41.999581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.003258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4179f2d0-3825-4ddb-81f9-af1e32666c7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:42.011687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:42.012587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:42.013347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 35/76] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:42.014231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d594e-f1dd-4408-9f85-cf41e9bd430b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.014524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d594e-f1dd-4408-9f85-cf41e9bd430b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.014801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d594e-f1dd-4408-9f85-cf41e9bd430b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.016231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 36/77] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.016831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d594e-f1dd-4408-9f85-cf41e9bd430b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.022878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.099712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:42.100489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.115095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.118796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d594e-f1dd-4408-9f85-cf41e9bd430b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.152064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.152966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.153254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.153531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.154726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.156174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.157819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 37/79] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.161033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.199078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ae6f-af1d-4118-be26-e0da338cd7b9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.217444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.232047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.232813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.233101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.233377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.234118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:42.234426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.235822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b4115-25ca-4fd8-869b-4542cb19a589 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.244644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 43/80] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.245853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.246148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.246425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.259031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f7e4d-67b3-48c8-a8ce-d5ac730ec9be None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.261849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.263036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.292635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.293291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.293570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.293846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.294572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:42.294872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.296260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.305897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 38/81] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.306533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.330343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 44/82] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:42.331198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.343544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.412432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee405-6672-4cbf-8f1a-d1eb00f67dcb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.446455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.447963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.448305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.448588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.449375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73b99-ca9d-46e9-83d3-14c282c5f8af None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.449780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.451223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.452968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 39/83] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.453729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.464039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.483618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.484344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.484623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.484899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.547262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.550818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.551082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c904a-7851-4fcd-9dea-9cd2408cde5d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.552322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.585273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.586139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.586425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.586698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.587934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.589471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.591134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 40/84] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.591905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.651303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 45/85] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:42.652443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.667546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.690553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec45ca-89d0-4791-8147-381e3934ee3f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.723681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.724583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.724869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.725146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.726337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.727794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.733961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 41/86] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.733961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.755565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f629b2-583e-4b3e-b226-6790aa04cf54 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.764619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.789461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.790245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.790556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.790836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.791993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.793494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.795085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 46/87] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.795843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.828993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135cf4-1759-4488-8857-7897060b2ccc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.862419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.863072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.863361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.863636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.864496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:42.864813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.866265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.872150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 42/88] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.872951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.883824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.906921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1df0-ee4d-4637-bb8e-b57988fbf996 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.946092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.946909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.947148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.947423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.985540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.990446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86736edb-d3bf-4eaa-a1e1-0462a00d0e45 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.026548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.028349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.028892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.029771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.030059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.030347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.031592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.033096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.039680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 43/89] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.039680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.117742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.138679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 47/90] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:43.139673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.150648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12742d8-a2a8-4450-91e7-1ad9962ad0a0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.186840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.187877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.188162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.188459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.222962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.250190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e2ac-a728-44c7-a9c3-71ae19513b04 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.260870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.262653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.285726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.286563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.286668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.286932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.287636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.289144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.361768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 44/91] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:43.362617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.390172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 48/92] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:56:43 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:43.391056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.440844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.450771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.500324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937ad5-96f7-4897-8f7a-f420ef813844 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.520892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbefb-a6f5-4630-a826-b2c95bea45ec None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.547954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.549776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.550271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.550916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.552363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=d15f9567be7a45d68d8b1259f6bb9e07) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.553106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.556854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.560661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.561603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.561990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.562290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.563640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.564491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 45/93] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/role_assignments?user.id=d15f9567be7a45d68d8b1259f6bb9e07&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.565681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.571014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.581005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 49/94] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.586512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.715435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ec18-85c6-49c6-a769-d7ebdaf3b95c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.734602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450bf36-4abe-4444-8daf-bda8a312199d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.738531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.757877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.768249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.769310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.769651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.770004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] PATH_INFO: `/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.771609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] RBAC: Authorizing `identity:get_project(project_id=f09d4bfda94e4ab29f07b5c5cb332607)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.774321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.777896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 46/95] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.784071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.784625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.785408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.785814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.786208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.787159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.787604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.789324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d6df2-f3fe-46ee-ac4e-07ec6c952887 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.799944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 50/96] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:43.923195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f148a-27a4-455e-8ac9-7a799bb65149 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.961186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.961864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.962190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.962966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.963822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=f09d4bfda94e4ab29f07b5c5cb332607, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.964135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.965655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84d61-e3da-4cb7-801b-330d4e36a6ab None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.972101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 47/97] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=f09d4bfda94e4ab29f07b5c5cb332607&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:45.690439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18de-deba-4770-bcdd-1f2cbb043bfe None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.691057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18de-deba-4770-bcdd-1f2cbb043bfe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.691057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18de-deba-4770-bcdd-1f2cbb043bfe None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.692334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 51/98] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:45.702230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.702766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.702766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.727845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:45.729110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:45.796908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:45.811465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 48/99] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:45.847269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f18de-deba-4770-bcdd-1f2cbb043bfe None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:45.989184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f18de-deba-4770-bcdd-1f2cbb043bfe None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.035452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.036317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.036602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.036869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.053074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:46.061054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:46.061943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:46.062729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 52/100] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:46.068018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.230126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf9f4-4bd0-4b2d-9fed-f6ebcf6a9462 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.270511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.271109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.271388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.271660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.272424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:46.272728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.274159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.287684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 49/101] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:46.293899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.374363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.474879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb7ca-1e8e-4724-bdd7-e42e11a81d7f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.521025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.521844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.522136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.522416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.523739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.525826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d863b7d-e8df-4e3b-9455-b2bff666695e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.527808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 53/102] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:46.533368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.622875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.655354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694c53-a0cf-40c0-936e-2848b8659843 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.655651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694c53-a0cf-40c0-936e-2848b8659843 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.656189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694c53-a0cf-40c0-936e-2848b8659843 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.658173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 54/103] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:46.666438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd903-a724-4c9e-89a6-5e9a8026529e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.667069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd903-a724-4c9e-89a6-5e9a8026529e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.667707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd903-a724-4c9e-89a6-5e9a8026529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.697740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-feddd903-a724-4c9e-89a6-5e9a8026529e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:46.699948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-feddd903-a724-4c9e-89a6-5e9a8026529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.700508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da4a-90fc-4e3c-a63c-32b0f160b223 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.767439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.769588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.770585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.771500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.774508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.776981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.779063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 50/104] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:46.786754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.820672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 55/105] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:46.833261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ae1a-f166-41cb-9d1e-fa0e6c16dfbf None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.833553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ae1a-f166-41cb-9d1e-fa0e6c16dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.833823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ae1a-f166-41cb-9d1e-fa0e6c16dfbf None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.835358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 56/106] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:46.840978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.841659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.841775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.864500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:46.865880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.912230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.916129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b53-b5ef-4949-bea7-23318af0e3cc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.948170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 57/107] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:46.948170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.957536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.986718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.987801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.988167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.988913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.997031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, user_id=19d48b7a78714c4cacfe2e4207b6df7e, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.998600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.052889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce02a6-e901-41f0-865b-f79d846e630d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.078798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 51/108] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:56:46 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:47.079777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.092259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.093481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.094076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.094559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.107239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6b550364-aca2-470d-95a3-4adc9411e871 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:47.116221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:47.117086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:47.117825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:47.120979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 58/109] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:47.122597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9fdb-7314-493c-8535-1b0198c649d0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.123189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9fdb-7314-493c-8535-1b0198c649d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.123671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb9fdb-7314-493c-8535-1b0198c649d0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.129366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 59/110] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:47.131635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb9fdb-7314-493c-8535-1b0198c649d0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.188611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.251779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb9fdb-7314-493c-8535-1b0198c649d0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.263977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68e43-0d3d-49ac-900f-7175afd65432 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.309750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.310745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.312573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.312896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.325932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.326628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.326913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.327191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.330306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:47.330627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.335711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e19c9-1e44-49f4-9288-d94275e0935c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.338645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:47.352461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:47.353966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:47.354795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:47.355377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 60/111] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:47.356984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.356984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.357309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.359489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 52/112] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:47.362662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.392055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:47.393328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:47.444848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.488297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 61/113] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:47.489684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.511840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2767-a0ea-4a9f-9cb6-8980c84c0132 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.513851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.547842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.548756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.549046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.549327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.550540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.552010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702d4ff-13b3-4608-9e4d-6db529a5f3d7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.553953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 53/114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:47.558783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15a0f-f255-4e97-84f1-78a9faab8c28 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.558783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15a0f-f255-4e97-84f1-78a9faab8c28 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.558783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15a0f-f255-4e97-84f1-78a9faab8c28 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.558783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 54/115] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:47.558783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15a0f-f255-4e97-84f1-78a9faab8c28 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.603247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef7b1-0f41-4b4f-a97d-68a0b46b4a56 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.640930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.641638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.641922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.642197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.643264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:47.643576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.645002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e349e65-b763-4268-85f4-933e6f20727a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.654321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 62/116] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:47.655865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdaa3f-8288-4abc-83f9-6fbe082e6eee None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.656155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdaa3f-8288-4abc-83f9-6fbe082e6eee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.656457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdaa3f-8288-4abc-83f9-6fbe082e6eee None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.658194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 63/117] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:47.660449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdaa3f-8288-4abc-83f9-6fbe082e6eee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.673378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15a0f-f255-4e97-84f1-78a9faab8c28 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.686163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.712888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.713677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.713960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.714240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.725383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4233aaf9-081c-4f2e-b1e5-c0278e633e29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:47.733693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:47.734739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:47.735729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 55/118] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:47.736568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.736568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.736719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.744861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.756711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:47.757900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:47.783812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdaa3f-8288-4abc-83f9-6fbe082e6eee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.833935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 56/119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:47.833935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.835921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.837018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.837365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.840243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.840243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.840400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8243-3b21-4c17-842e-8da924fbabbb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.846643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 64/120] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:47.846643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.846643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.846643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.861628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:47.862774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:47.936349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.939029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b24608-9612-4bde-90ba-30ac970b5f58 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.952220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 65/121] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:47.952220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.975249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.976120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.976450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.976732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.977960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.979402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.981245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 57/122] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:47.981915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.030034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.077640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380bfe-db39-4f54-8c18-e57da0d6a056 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.087099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e07db-61b8-46a8-bc6f-28599c4c0d24 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.115007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.115930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.116476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.117045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.117854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:48.118160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.119646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.121800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.122603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.122894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.123176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.128932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 66/123] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:48.133318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:48.134855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:48.141776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:48.142719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:48.143484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 58/124] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:48.144181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.174530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.242489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902aef9-b341-41c4-b3ae-a82a721dbc8d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.249983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd764e-b244-4739-9c12-62f4134d26b9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.271845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.278078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.279013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.279298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.279613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.282557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, user_id=19d48b7a78714c4cacfe2e4207b6df7e, role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.284061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.289805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.291189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.291528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.291896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.293153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.294662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.296362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 59/125] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:48.296362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.395262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.412227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 67/126] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:56:48 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:48.412456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5e1b-fd9f-4030-b1db-8d547d0b16fd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.412551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.463164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.464184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.464571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.464917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.467526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.470040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.472470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 60/127] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:48.473938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.518844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457ab69-d30c-42fb-beb6-814422f11fc3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.562172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.563180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.563543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.563913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] PATH_INFO: `/v3/users/29d6010882a24647a18a714f4fab5867` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.580477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] RBAC: Authorizing `identity:get_user(user_id=29d6010882a24647a18a714f4fab5867)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.582108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.584041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 68/128] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/users/29d6010882a24647a18a714f4fab5867 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:48.584947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.617145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4a54-4b9e-4e41-8ac7-0f5172ea3d9b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.648491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.660443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.661435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.661723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.661996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.663081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:48.663923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.667091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.687805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 61/129] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:48.687805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.709243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82865a-34d8-4c72-8919-04a3f0aa333d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.718457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.746438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.747190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.747373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.747647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.748387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.749921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.799190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979b9f-e457-49a1-9cef-c3560a91517e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.833626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.834505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.835028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.835028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/d15f9567be7a45d68d8b1259f6bb9e07/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.836972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, user_id=d15f9567be7a45d68d8b1259f6bb9e07, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.838479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.853691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 69/130] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:56:48 2022] POST /identity/v3/projects => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:48.854809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.955717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 62/131] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:56:48 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/d15f9567be7a45d68d8b1259f6bb9e07/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:48.964496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.998736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.003094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855de7-b72a-4774-aa8c-4cc908862bf4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.113865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.114910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.115429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.115892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.130160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.155645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf603-ba34-438f-878a-a32e0d517524 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.198850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.199740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.200024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.200329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.205969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.207388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.214772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 63/132] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:49.215722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.280951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.282811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.397403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768649-4ba3-4355-b753-9dafaab993ea None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.442977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.443871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.444159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.444462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] PATH_INFO: `/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.450395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.451648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] RBAC: Authorizing `identity:get_project(project_id=f09d4bfda94e4ab29f07b5c5cb332607)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.453434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.455008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 70/133] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:49.456146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 64/134] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:49.466413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.466792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.529902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.608483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5430-a4c9-4605-8995-e2eec93388cd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.659995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.661053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.661345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.661623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] PATH_INFO: `/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.667695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] RBAC: Authorizing `identity:create_grant(project_id=f09d4bfda94e4ab29f07b5c5cb332607, user_id=19d48b7a78714c4cacfe2e4207b6df7e, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.669197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84f2b-2244-4314-a926-da361b4080fa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.692584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f2233-1408-4aa9-b1da-c0d5ff8e2d98 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.729675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.730552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.730837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.731115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.732437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.733882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2a161-00df-4b53-a21f-653410b47d51 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.736231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 65/135] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:49.737552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e0e-5e1f-4600-8223-f09419ab3c7f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.737838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e0e-5e1f-4600-8223-f09419ab3c7f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.738119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e0e-5e1f-4600-8223-f09419ab3c7f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.739523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 66/136] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:49.744130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928e0e-5e1f-4600-8223-f09419ab3c7f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.766619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 71/137] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:56:49 2022] PUT /identity/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607/users/19d48b7a78714c4cacfe2e4207b6df7e/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:49.767959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.768172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.768481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.805426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:49.806718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:49.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.887997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928e0e-5e1f-4600-8223-f09419ab3c7f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.927273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.927989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.928306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.928890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.929730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=29d6010882a24647a18a714f4fab5867) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:49.930041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.932097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.938447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 67/138] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/role_assignments?user.id=29d6010882a24647a18a714f4fab5867&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:49.947821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.974820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 72/139] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:50.016144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:50.161822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb744df-0996-44df-9063-fd22d9f61acb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:50.208476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:50.209285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:50.209571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:50.209846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:50.224312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:50.232323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:50.238466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:50.239335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 68/140] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:50.239962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:50.385055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2111a-b1d4-4a50-9ba3-c0aa7d74d5c7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:50.421999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:50.422679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:50.423010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:50.423289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:50.424036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:50.424468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:50.425876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:50.435079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 73/141] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:50.440760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:50.459261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:50.568837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730109d-e89b-40fe-b98e-6f5e0e4279aa None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:50.611996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:50.612816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:50.613097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:50.613366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:50.614577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:50.616027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:50.617688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 69/142] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:50 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:50.623738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:50.681397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:50.731674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fbfab-cf0a-4d33-8444-dfa4bf3a5012 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:50.769212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:50.769849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:50.770143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:50.770425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:50.852921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:50.854421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:50.924699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:50.983479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 74/143] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:50.993304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:51.105957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:51.126625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d5c4-a153-45b2-bbb9-8d30b5f738cb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:51.163766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:51.164978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.165969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.166429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.167834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:51.169479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fc9a-16a1-4505-81e7-73736b127212 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:51.171456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 70/144] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:50 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:51.177618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:51.323314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9519a1-9e72-4463-8143-882a97feed3e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:51.361583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:51.362238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.362520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.362791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.363610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:51.363917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:51.365397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909628-ddcc-438e-bd1c-26eb2cf4830e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:51.371785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 75/145] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:51 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:51.498451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2886eb-51dc-4ad3-a7a8-e532f50ff010 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.499114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2886eb-51dc-4ad3-a7a8-e532f50ff010 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.499581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2886eb-51dc-4ad3-a7a8-e532f50ff010 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.501211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 71/146] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:51.511057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.511338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.511630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.533209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:51.534416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:51.546787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:51.628905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 76/147] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:51.673084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2886eb-51dc-4ad3-a7a8-e532f50ff010 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:51.810961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2886eb-51dc-4ad3-a7a8-e532f50ff010 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:51.850758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:51.851974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.852465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.852987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.866017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:51.874728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:51.875564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:51.876376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:56:51.878740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 72/148] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:56:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:51.885450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.006694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf44e2-120d-413d-871c-65c4a8d7c67b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.047677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.048391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.048676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.048948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.049689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:52.049994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.051400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.061374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 77/149] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:52.067251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.089005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.209952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0436-2407-44ff-a0c0-e32b6fc5e1fe None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.254484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.255760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.256264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.256729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.258269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.260557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a833aa5-b365-4937-90f9-d5ff8ba38c27 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.262527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 73/150] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:52.273366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.292536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.415629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ac60-a733-47c4-abf7-2a1c830f1789 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.426071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead416be-aaa7-499d-8c5b-6998b722ae98 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.426556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead416be-aaa7-499d-8c5b-6998b722ae98 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.426897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead416be-aaa7-499d-8c5b-6998b722ae98 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.428648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 74/151] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:52.437494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7847-1229-4bbd-aab2-6623fae333bc None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.437781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7847-1229-4bbd-aab2-6623fae333bc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.438283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7847-1229-4bbd-aab2-6623fae333bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.462947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.463606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.463891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.464165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.470887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fa4c7847-1229-4bbd-aab2-6623fae333bc None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:52.472076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fa4c7847-1229-4bbd-aab2-6623fae333bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:52.593845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.595570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.607213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.608557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 75/152] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:52.610027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f74-ce92-4731-8c7e-87473c455759 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.610321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f74-ce92-4731-8c7e-87473c455759 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.610596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f74-ce92-4731-8c7e-87473c455759 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.611916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 76/153] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:52.624552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.624713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.624960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.652840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:52.654036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:52.656097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.719485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 78/154] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:52.720430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.730157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 77/155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:52.731375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.848792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a68f28-9a3a-42c1-9f51-a790908bd6f0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.859151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.863356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc63da-47b4-4411-8f2b-123b59455113 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.883729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.884582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.884862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.885135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.895579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:52.905730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:52.906715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:52.907492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:52.909747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.910894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.911400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.911883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.911989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 79/156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:52.913044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.913908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.916271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.919755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 78/157] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:52.920906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.934354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.045121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274ec6-144e-4517-8c3e-7c7f5fabcb72 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.045310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e0ce-2852-4361-9e85-af02a78de7cd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.082321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.083236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.083677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.084030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.085296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.087616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.088654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.089646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 80/158] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:53.090284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.090719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.091159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.092117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:53.092597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.094115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.094952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.103777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 79/159] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:53.104867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.139032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.175563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.200983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774c80-2154-4a8d-9f04-dec5253566fe None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.208305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844fbe-cd4c-4c4d-8e41-ef5254505a56 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.234800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.235445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.235721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.235992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.236846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:53.237152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.238597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.241537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.242199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.242478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.242751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.243912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.244466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 81/160] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:53.245241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.246629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a5e92-1bf0-454c-ac6b-0c74c5d0f344 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.364789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 80/161] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:56:53 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:53.364789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8046-44ab-4c08-96d4-696b6d33771a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.364789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8046-44ab-4c08-96d4-696b6d33771a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.364789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8046-44ab-4c08-96d4-696b6d33771a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.364789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 81/162] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:53.366425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088651e-2b0d-46ca-8cd0-9b4c87dbac6f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.366907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088651e-2b0d-46ca-8cd0-9b4c87dbac6f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.367309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088651e-2b0d-46ca-8cd0-9b4c87dbac6f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.373103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 82/163] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:53.373103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.373103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.373103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.377606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.381010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36ce22-b747-4cb0-99fe-1987a4a322e9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.393732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:53.395083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:53.429977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.431227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.431668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.431961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] PATH_INFO: `/v3/users/d15f9567be7a45d68d8b1259f6bb9e07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.433755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] RBAC: Authorizing `identity:get_user(user_id=d15f9567be7a45d68d8b1259f6bb9e07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.434942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a882bf1-4818-4294-befb-94adde9a8a6b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.436727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/users/d15f9567be7a45d68d8b1259f6bb9e07 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:53.438031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.438316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.438592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.460311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:53.461640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:53.511573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 83/165] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:53.512513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.553880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 83/166] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:53.555244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.603189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.656953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43593d-25d0-4346-ad26-8d59b01524b8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.666167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.670652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cda2a-cfcf-48bb-98b0-421f6de4722e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.702376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.703016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.703295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.703566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.713213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.714015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.714297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.714570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.728358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:53.736127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:53.737137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:53.738130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:53.738784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.797128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.800634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.868908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.872012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e3-6b9b-42c9-ae24-b0ecb269eb17 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.919389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.920111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.920455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.920731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.926495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 84/168] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:53.927356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.935544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:53.945496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:53.946462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:53.947316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 85/169] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:53.947952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:53.975143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.051381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3081eb-37c8-4e0d-8869-e9284ea30b4d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.089115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.089752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.089962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.090410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.091231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:54.091545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.093083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.093654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107700a5-f5bc-4286-bdfd-829cb4bd0a61 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.103024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 85/170] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.103824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.137586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.138109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.139802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.140309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.140804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.142212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.144521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.146669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 86/171] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:53 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.147753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.297585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.301755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f09c-5d66-4adc-a8c6-b514fee3ff7f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.334569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b3ce-1e0d-4c27-82d5-ea84a806914c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.351168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.351901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.352192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.352528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.353340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:54.353645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.355434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.368602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.368602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.442036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.442912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.443187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.443457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] PATH_INFO: `/v3/users/19d48b7a78714c4cacfe2e4207b6df7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.448932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] RBAC: Authorizing `identity:get_user(user_id=19d48b7a78714c4cacfe2e4207b6df7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.450492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.452361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 87/173] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/users/19d48b7a78714c4cacfe2e4207b6df7e => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.453090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.454586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.479606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4f23a-da50-43c2-a6dc-0fac17ea640f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.519472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.520133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.520493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.520778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.522530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=d15f9567be7a45d68d8b1259f6bb9e07) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:54.522853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.524858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.531680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/role_assignments?user.id=d15f9567be7a45d68d8b1259f6bb9e07&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.532888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.656455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f21e-5f8b-4ef0-a801-1d3e325ed9f8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.697753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.698586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.698881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.699158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.713405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.714359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b1d78-14b2-423e-9967-b281c1bfdcfa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:54.783160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.784728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.826339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:54.827226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:54.827501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:54.827768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] PATH_INFO: `/v3/users/29d6010882a24647a18a714f4fab5867` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:54.832984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] RBAC: Authorizing `identity:get_user(user_id=29d6010882a24647a18a714f4fab5867)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:54.834494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:54.836397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 88/175] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/users/29d6010882a24647a18a714f4fab5867 => generated 289 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:54.842487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.905692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 88/176] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:54.906039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:54.911598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:54.962261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.028857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446df0c-b706-4a3b-927c-e7bd1e20c1ab None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.065026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.065891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.066178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.066448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] PATH_INFO: `/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.067642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] RBAC: Authorizing `identity:get_project(project_id=f09d4bfda94e4ab29f07b5c5cb332607)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.069343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.071111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 89/177] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/projects/f09d4bfda94e4ab29f07b5c5cb332607 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:55.077888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:55.093201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a36e9-9c88-4544-a771-e50b49747672 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.145891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.146766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.147046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.147317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.148544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.150029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.151714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:54 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:55.157417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:55.200266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c800012-ed4b-4969-b734-d4d77b6028d5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.214264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.236904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.237596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.237904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.238214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.239051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=f09d4bfda94e4ab29f07b5c5cb332607, user.id=19d48b7a78714c4cacfe2e4207b6df7e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:55.239364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.240864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fe786-329f-4a64-8620-2fd5d5dd8919 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.247834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 90/179] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:55 2022] GET /identity/v3/role_assignments?user.id=19d48b7a78714c4cacfe2e4207b6df7e&scope.project.id=f09d4bfda94e4ab29f07b5c5cb332607&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:55.318698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.336699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ff14f-b225-4fc7-9b46-64d9146a4a7e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.384141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.385126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.388618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.388903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/29d6010882a24647a18a714f4fab5867/roles/ab23f5d906bb4ff8bc9b69169b17fe4a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.391113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, user_id=29d6010882a24647a18a714f4fab5867, role_id=ab23f5d906bb4ff8bc9b69169b17fe4a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.392662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcbf5-29a0-4c1c-936a-dad3505a8b8a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.474615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 90/180] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:56:55 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/users/29d6010882a24647a18a714f4fab5867/roles/ab23f5d906bb4ff8bc9b69169b17fe4a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:56.218450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93799-ab0e-4911-9c01-819b31a2957b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.218988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93799-ab0e-4911-9c01-819b31a2957b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.218988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93799-ab0e-4911-9c01-819b31a2957b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.220396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 91/181] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:56.225656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.226080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.226258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.243776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:56.245026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:56.312843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d1ce-9abe-420c-9b84-ab220007d263 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.313300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d1ce-9abe-420c-9b84-ab220007d263 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.313579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d1ce-9abe-420c-9b84-ab220007d263 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.315559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 92/182] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:56.322259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.322259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.322259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.324955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 91/183] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:56.345546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:56.347032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:56.351934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.419643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 93/184] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:56.444821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.455304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.476088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2ab2-67df-4311-9220-a3c120c4c649 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:56.512755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:56.513847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.514181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.514968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.527286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1f3121a7-1b2f-44c9-8433-1054f80806ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:56.534864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:56.535743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:56.536556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 92/185] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:56.542503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44489-8dd2-48ed-9b27-90fbb093c551 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.542737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44489-8dd2-48ed-9b27-90fbb093c551 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.543016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44489-8dd2-48ed-9b27-90fbb093c551 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.544304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 93/186] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:56.548348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44489-8dd2-48ed-9b27-90fbb093c551 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.554491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14640a-eb77-47b3-80a8-8eb7f6e289f7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:56.557940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.589949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:56.590735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.591014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.591281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.592550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:56.594059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2083-870d-4757-b725-206e13207886 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:56.596660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 94/187] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:56.598105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.598391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.598665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.615710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:56.616915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:56.657467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44489-8dd2-48ed-9b27-90fbb093c551 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:56.693695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:56.694374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.694660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.694939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.695692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:56.696003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:56.697558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:56.700386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 95/188] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:56.701356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.710549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 94/189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:56.715622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.718036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.814259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bee18f-c500-457b-b669-1b3dbe89bb56 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:56.815892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.823881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46a10-4b78-469f-aa4c-902d4ef7a9c9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:56.850349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:56.851012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.851287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.851616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.852261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:56.853927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:56.861591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:56.862903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:56.863194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:56.863597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:56.874183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:56.882251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:56.883131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:56.884036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:56.884736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.944393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.972244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 96/191] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:56:56 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:56.972244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:56.999471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac6f41-e87d-4c0e-b6c4-dffda4eac6bf None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.039543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.040493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.040773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.041044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.058584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.060086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.061903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 96/192] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:57.068023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:57.126305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcbe3-d4f9-46bc-94b2-cac7e307a2af None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.173579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.174111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.174389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.174661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.175442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:57.176253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.177149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.189075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 97/193] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:56:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:57.194297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:57.215666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152451bd-b4b6-423e-be78-45e843300963 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.222042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.242481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.269725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.270470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.270857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.271134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.331076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075214-48f9-49e3-ab26-a595a9426ee7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.357007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.358497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.386716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.387934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.388901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.389413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.391194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.393594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.396071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 98/194] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:57.401658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:57.492278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 97/195] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:57.497135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:57.520583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.523250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.561420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b17f7-cb8f-4f42-9a0b-246088ad7ce0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.611302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92d22-1121-4bab-8eaf-a6c3423e7450 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.652991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.653876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.654149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.654420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.656036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.657561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.665114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.665803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.666083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.666354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.667817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:57.684504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:57.811635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.813484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.815713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.836973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b83e8-b567-407e-8250-d0ea5d804f98 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:57.880480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:57.881151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.881506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.881853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.882773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=e5782a574d3e4453a0405a2e44cc7c5c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:57.883173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:57.884827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8f3c-c1e7-48ca-a5fd-f24fd0ba3fd8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:57.890396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 99/197] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/role_assignments?user.id=e5782a574d3e4453a0405a2e44cc7c5c&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:57.891691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70c3c-8a70-4f18-939a-b3b647777871 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.892054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70c3c-8a70-4f18-939a-b3b647777871 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.892431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab70c3c-8a70-4f18-939a-b3b647777871 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.897893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 100/198] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:57.900502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.900788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.901066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.918536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:57.919776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:57.944651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:57.960140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 99/199] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:56:57.967188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.078592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 101/200] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:58.127059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.152515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce51b-ce9b-4f39-ac6e-8d6df30a95a7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.211807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.212696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.212976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.213248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.214539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.216023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.219053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 100/201] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:58.224870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.281172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.306278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.312346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4021-810f-44c2-8b0e-de146ab76a59 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.369328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.370731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.371235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.371710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.384607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:58.393146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:58.394028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:56:58.394869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:56:58.397829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 102/202] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:58.403925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.435047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9a82-ef57-4246-b1b9-1e7cadf193e2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.527352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3d3ad-3e4a-4b1a-9a82-46d373f4068a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.535644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.536339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.536620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.536899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.537735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=e5782a574d3e4453a0405a2e44cc7c5c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:58.538043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.539486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.552770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 101/203] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/role_assignments?user.id=e5782a574d3e4453a0405a2e44cc7c5c&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:58.575715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.576807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.577293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.577765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.578713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:58.579268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.580929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.600781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 103/204] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:58.607082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.762299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cb72e-489d-4ad9-b05b-40b983da0c5c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.782921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.797582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.798458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.798736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.799005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] PATH_INFO: `/v3/users/29d6010882a24647a18a714f4fab5867` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.800284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] RBAC: Authorizing `identity:get_user(user_id=29d6010882a24647a18a714f4fab5867)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.801720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.818993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 102/205] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/users/29d6010882a24647a18a714f4fab5867 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:58.819117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.819117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.934806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa8ced-096c-4909-8c11-31794ad38bf7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.979793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.980504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.980784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.981056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.077326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:59.078738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:59.082030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:59.207045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 104/206] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:59.212737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:59.384065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02a5e-2df4-4cd2-aa7d-a5b5295723fb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:59.427681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:59.428840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.429117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.429381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.430640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:59.432073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923a286-e3be-4b7c-a65e-89b530aded68 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:59.433792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 103/207] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:56:59 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:59.439694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:59.596558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557cd7c-d85a-4a00-84bd-df7e37935b16 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:59.605185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:59.653776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c43fa-e3ee-41e1-9fcc-488434fd8475 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.654884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c43fa-e3ee-41e1-9fcc-488434fd8475 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.655758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c43fa-e3ee-41e1-9fcc-488434fd8475 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.657802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 104/208] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:59.660887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:59.661753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.662196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.662604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.663573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c, user.id=29d6010882a24647a18a714f4fab5867) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:59.664019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:59.665787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:59.673749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c57a3-46b6-42b6-b496-9ffd8a181663 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.674230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c57a3-46b6-42b6-b496-9ffd8a181663 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.674639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c57a3-46b6-42b6-b496-9ffd8a181663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.685004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 105/209] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:56:59 2022] GET /identity/v3/role_assignments?user.id=29d6010882a24647a18a714f4fab5867&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:59.705508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3f3c57a3-46b6-42b6-b496-9ffd8a181663 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:59.707023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3f3c57a3-46b6-42b6-b496-9ffd8a181663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:59.776005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:59.807325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 105/210] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:59.855501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:59.899609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3c81-736b-464e-a5de-0c4e8b001228 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.900250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3c81-736b-464e-a5de-0c4e8b001228 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.900755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3c81-736b-464e-a5de-0c4e8b001228 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.902225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 106/211] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:59.908182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:59.908610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:59.908978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:59.931088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:59.932398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:59.976101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68e14-02fe-40c7-9924-60dd2d1f9331 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.007849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:00.021440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.022489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.022983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.023428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.033520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.034831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:00.047828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:00.048936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:00.049940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:00.053282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:00.058648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.108097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.172040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7e061-aaf9-464d-8560-7ed165d1dfb3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.192251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.211439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.212897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.213437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.213940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.215995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:00.217658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:00.219059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e426d-828d-408e-9a32-8a8803103fe1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.219420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:00.224928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.260825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.261538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.261821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.262099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.262905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:00.263216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:00.264639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:00.278520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:00.279420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.350505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8950-3144-4fb5-a74c-fc0d17811122 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.387909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.388657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.389601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.389993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.390932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:00.392863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce2d9-494d-41ec-a529-0cfa98202521 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:00.417267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.427368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e888935-f97d-45af-8bd5-6b5a54e47cd6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.463871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.465574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.466005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.466424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] PATH_INFO: `/v3/users/60da124d454443aeaad3bd363b5d88d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.484417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] RBAC: Authorizing `identity:get_user(user_id=60da124d454443aeaad3bd363b5d88d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:00.486249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:00.492727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 108/216] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/users/60da124d454443aeaad3bd363b5d88d2 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:00.494040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.517165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 109/217] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:00 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:57:00.625197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2685b9-e39b-47ab-adb4-c5cd4aabd753 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.663786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.664975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.665478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.665775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.666766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968ce6c-93f5-4d39-baa5-00b899019b47 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.667053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968ce6c-93f5-4d39-baa5-00b899019b47 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.667323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968ce6c-93f5-4d39-baa5-00b899019b47 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.668957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 110/218] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:00.674385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.674665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.675049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.688817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.695427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:00.697356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:00.739531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.757254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:00.759372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:00.774499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 111/219] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:00.799117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.893680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 109/220] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:00.899658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:00.929831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ad897-c1ff-4fff-8668-03c427f21392 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:00.957994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:00.978510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:00.979562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:00.979981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:00.980376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:00.994718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:01.005711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:01.006605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:01.007387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:01.007977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 112/221] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:01.015052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.017953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b933-dc93-4392-96fc-e40db1df1e1c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.048298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.057339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.059710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.059710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.059710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.060775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.063056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.065532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 110/222] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:00 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:01.072866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.129822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f7b4-8ea4-4fb8-bd6c-69e5d3da3fdf None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.210596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c15a-9cb4-4677-a2b3-b0c0c4e2e1a1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.240754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.246594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.247579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.248000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.248543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.249104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.249665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:01.249906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.250254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.256298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.256298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.256298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=60da124d454443aeaad3bd363b5d88d2) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:01.256298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.256298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.258207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77843-bc89-4ee5-be07-e889b1c44523 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.259251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/role_assignments?user.id=60da124d454443aeaad3bd363b5d88d2&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:01.276338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 113/224] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.282416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.364570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db87b-f3e8-443f-b9b6-0fbeefb816de None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.364909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db87b-f3e8-443f-b9b6-0fbeefb816de None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.365136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db87b-f3e8-443f-b9b6-0fbeefb816de None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.366553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 114/225] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:01.372519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.372804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.373082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.390541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:01.391935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:01.469957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 115/226] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:01.470486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25d26-3b9f-4c3a-8080-538e9d5087f0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.492519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.519894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.526673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.527717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.528006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.532043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.532043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.532922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.534944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 112/227] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.542011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.648233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.652180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a67f4-a4dd-4eef-b4f6-b053b90e6bf3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.689118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.689924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.690206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.690479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.702187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:01.711293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:01.712274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:01.713692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 116/228] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:01.718810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.751029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02d748-8944-457c-8fe0-1a82864223c0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.815574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.835495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba25bac-102f-44f0-a990-06c04ce428b1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.842931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.844112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.844628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.845094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.846481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.848124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.850044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 113/229] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:01.856337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.871761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.872492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.872776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.873104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.873847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:01.874203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.875633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.885012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 117/230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:01.890787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.999782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac9f0-7ae8-47bc-b66f-5ac491ccf765 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:02.036823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:02.037638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:02.037923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:02.038202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:02.039540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:02.044405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:02.044405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 118/231] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:02.064299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:02.093837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:02.135434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3da3b-e23b-4437-a5bf-56ab0226a836 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:02.157474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:02.185547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:02.186437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:02.186721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:02.186992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/e5782a574d3e4453a0405a2e44cc7c5c/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:02.189920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, user_id=e5782a574d3e4453a0405a2e44cc7c5c, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:02.191381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b919-3cc6-4669-877e-cce773d0615f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:02.216820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d9b67-7a83-4e2a-999c-e35c080e98e9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:02.253485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:02.254397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:02.254685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:02.254956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:02.256236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:02.257742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:02.260422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 119/232] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:02 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:02.265503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:02.285801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 114/233] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:01 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/e5782a574d3e4453a0405a2e44cc7c5c/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:57:02.354196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:02.374337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a894-44c5-4479-909b-c2fc60b7f09b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:02.410482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:02.411393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:02.411678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:02.411953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/e5782a574d3e4453a0405a2e44cc7c5c/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:02.414373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, user_id=e5782a574d3e4453a0405a2e44cc7c5c, role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:02.416015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb109be-ec62-4d3a-ab27-7aa7a1089193 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:02.514240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 120/234] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:02 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/e5782a574d3e4453a0405a2e44cc7c5c/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:03.405310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571d4b-a1c5-4f04-8327-f5d04d4705f6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.405817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571d4b-a1c5-4f04-8327-f5d04d4705f6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.405926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571d4b-a1c5-4f04-8327-f5d04d4705f6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.407353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 115/235] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:03.421798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.422275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.422349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.441673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:03.442923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:03.479410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0dcf-71c6-4a42-9f8d-d3b29b461244 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.480022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0dcf-71c6-4a42-9f8d-d3b29b461244 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.480566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0dcf-71c6-4a42-9f8d-d3b29b461244 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.482335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 116/236] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:03.487632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.488159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.488659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.505811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:03.507310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:03.534979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 121/237] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:03.558160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:03.623445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 117/238] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:03.651734 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:03.689075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:03.748482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a245dc2-490b-45ce-8156-83cfcdb16ac0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:03.807578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:03.808848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.809407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.810738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.832018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:03.840828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:03.841701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:03.842479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:03.848569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f882-a554-4902-938f-34171aef1c16 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:03.857017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 122/239] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:03.857559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:03.865582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:03.914282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:03.916044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.916588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.917078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.922873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:03.924626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:03.926496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 118/240] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:03.933329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.006797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eec22-72b3-4bf8-8957-3971faab0a3f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.041701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.049575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.050975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.051398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.052347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.052595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:04.052900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.053254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8f17-f100-41f5-a034-e5a4df4282df None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.054560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea859-ed62-4ba5-8409-bca5277a039f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.068571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 123/241] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.068571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6e0-3439-43e9-872b-5761b3712118 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.068571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6e0-3439-43e9-872b-5761b3712118 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.068571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6e0-3439-43e9-872b-5761b3712118 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.068571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 124/242] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:04.075807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee6e0-3439-43e9-872b-5761b3712118 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.099959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.100677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.100952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.101432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.102404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.104092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f598c-f715-482c-ad73-0139d3099f79 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.173706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 119/243] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:03 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:04.175685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.175978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.176566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.186171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee6e0-3439-43e9-872b-5761b3712118 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.199879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:04.201290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:04.233490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.234810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.235103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.235428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] PATH_INFO: `/v3/users/67a00c504b164e4fb87673782a3c4ea2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.237650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.259669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] RBAC: Authorizing `identity:get_user(user_id=67a00c504b164e4fb87673782a3c4ea2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.261650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.267091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 125/244] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/users/67a00c504b164e4fb87673782a3c4ea2 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.272316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.325452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 120/245] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:04.373641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.388989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.470492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfe1d-ec5c-4554-93cf-1dd591881d64 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.513839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.514490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.514787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.515308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.526020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822f2a-e370-47e9-9d79-fbe1a0e7a304 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.565813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.566980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.567450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.567926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.581134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:04.590731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:04.591640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:04.592834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:04.594901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 121/246] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:04.603259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.610474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.612246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.632339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.666904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.726348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 126/247] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:57:04.732728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba6c44-ae5c-455f-b267-f85b6e4298e1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.733508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.772725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.773394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.773674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.773978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.774715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:04.775017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.777577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.786172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 122/248] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:04.793284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.850925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd369e-56ef-416a-ab06-a9f9f2b31843 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.887425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.890252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.891383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.891838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.892383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.894591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.896357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.898344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 127/249] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:04.906351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.917981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502ff21-846f-469e-826a-72fa3e0c30c6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.927464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.964979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.966357 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.966977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.967457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] PATH_INFO: `/v3/users/60da124d454443aeaad3bd363b5d88d2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.969400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] RBAC: Authorizing `identity:get_user(user_id=60da124d454443aeaad3bd363b5d88d2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.971085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.973903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 123/250] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/users/60da124d454443aeaad3bd363b5d88d2 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.979395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.029969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2710a4-2626-49dd-8aa5-ecbc74f7a754 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.066300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.066300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.066564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.066831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.067632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=67a00c504b164e4fb87673782a3c4ea2) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:05.067938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:05.069391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cd26-77f7-4d00-9591-1dd67a7be2f2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:05.075400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 128/251] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/role_assignments?user.id=67a00c504b164e4fb87673782a3c4ea2&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:05.102673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21071-8c0e-42d6-b8f9-3432f27efd89 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.129476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194693a-5e85-42e4-a073-d703b9e82d17 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.129787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194693a-5e85-42e4-a073-d703b9e82d17 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.130020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194693a-5e85-42e4-a073-d703b9e82d17 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.136331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 129/252] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:05.142264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.142628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.142909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.143602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.144710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.145183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.145659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.147051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:05.149425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:05.151746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 124/253] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:05.177621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.177941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:05.179435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:05.214659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:05.306385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 130/254] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:05.344265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.359667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e312-cd28-4fe9-a7de-6ee814dfab7a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.369688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:05.410862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.411759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.412038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.412334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/60da124d454443aeaad3bd363b5d88d2/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.417575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, user_id=60da124d454443aeaad3bd363b5d88d2, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:05.419043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e426c2-79b0-4e42-bcc7-655311abe185 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:05.493531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804c13f-cd3a-4fbf-8ac4-f182d5f05d5f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.502461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 125/255] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:05 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/60da124d454443aeaad3bd363b5d88d2/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:57:05.506087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee6e7-9350-474b-ab95-771782aa0dfa None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.506087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee6e7-9350-474b-ab95-771782aa0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.506087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee6e7-9350-474b-ab95-771782aa0dfa None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.506087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 126/256] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:05.513355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.513922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.514374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.549272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:05.550489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:05.561819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.562974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.563435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.563886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.576731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:05.585158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:05.586153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:05.587072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:05.589991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 131/257] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:05.597179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.682616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 127/258] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:05.724609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:05.762075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bafce-e858-42ba-9b1f-c3a68583335c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.767293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.784579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:05.837763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.838353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.838631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.838903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.839652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:05.840047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:05.841462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:05.859198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 132/259] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:05.864678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:05.929607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b197cd-d232-4653-85d0-f5f8accc76ab None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.967159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:05.967995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:05.968324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:05.968659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:05.979719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:05.987942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf371e-99d3-4b8c-8d8c-ae79674cd825 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:05.988307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:05.989162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:05.990032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 128/260] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:05.995561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.041302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.042234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.042513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.042785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.048951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.050544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.052242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 133/261] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:05 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:06.058081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.062251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.068033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.104896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1ee16-4fde-476c-98f5-8b28046c4e34 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.141474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.142144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.142425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.142697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.143434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:06.143735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.145259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.154084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 129/262] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:06.159738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.262370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1d62-1502-4395-8c39-b17956982614 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.269432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8fb3c-c6e7-4750-bf32-321f782d34f3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.301257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.308458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.309667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.310079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.310471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] PATH_INFO: `/v3/users/e5782a574d3e4453a0405a2e44cc7c5c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.311789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] RBAC: Authorizing `identity:get_user(user_id=e5782a574d3e4453a0405a2e44cc7c5c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.313777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.315676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 130/263] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/users/e5782a574d3e4453a0405a2e44cc7c5c => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:06.322182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.357517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.358115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.358396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.361194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.432074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b8ca-57b2-4d30-8385-6246d11067f5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.468465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.469214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.469499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.469772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.480420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.481948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.483983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.540691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.544711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.546250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.653961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 131/264] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:06.659651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.685185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 134/265] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:57:06.690278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.762170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.769628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cec5-f200-48ee-97e8-778eb1d1e892 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.808727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.809930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.810385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.810840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.812255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.814002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.816011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 132/266] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:06.822410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:06.922170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7cfd-ee35-482a-a6b1-3afe44a3a28f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.923752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:06.928940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada52d-5aa1-4f3c-baab-ead39f02d931 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:06.968788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.969718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.970135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.970541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.971626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=e5782a574d3e4453a0405a2e44cc7c5c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:06.971936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.973409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.980417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 133/267] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/role_assignments?user.id=e5782a574d3e4453a0405a2e44cc7c5c&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:06.986515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:06.987713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:06.988240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:06.988706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:06.990221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:06.991899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861c811-f12f-4097-803c-2c11df86896c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:06.994915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 135/268] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:07.000678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:07.044719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:07.132799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e23a-4f8a-48e0-9983-c1c97ee7714e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:07.170020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:07.170683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.170960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.171229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.172063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=e5782a574d3e4453a0405a2e44cc7c5c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:07.172459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:07.173934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6996af-6878-439f-95d3-18ad8373bf77 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:07.181619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 134/269] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:06 2022] GET /identity/v3/role_assignments?user.id=e5782a574d3e4453a0405a2e44cc7c5c&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.010034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474998-60b3-40a9-8966-ff7b24640230 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.010546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474998-60b3-40a9-8966-ff7b24640230 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.010620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474998-60b3-40a9-8966-ff7b24640230 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.012254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 136/270] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:08.017668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.018078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.018254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.036105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:08.037536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:08.039015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713880a-bb42-4b8b-a613-0b76cc93de46 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.039306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713880a-bb42-4b8b-a613-0b76cc93de46 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.039652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713880a-bb42-4b8b-a613-0b76cc93de46 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.041209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 137/271] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:08.046008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.046298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.046575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:08.065240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:08.115585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 135/272] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:08.139239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.143977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 138/273] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:08.165100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.166422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.250751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c913f-bf27-4a68-a12e-87b34881cb60 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.270986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.273882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90455-1e4f-4657-8658-cf46d6b565c8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.290241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.291260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.291683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.292129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.306011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:08.311107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.311926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.312230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.312508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:08.315929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:08.316879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:08.317668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:08.321225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 136/274] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:08.325660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:08.326845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:08.335705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:08.337064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:08.337892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:08.340332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 139/275] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:08.341469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.443935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.453889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b77c7-77ea-4806-8ff3-35ddacc6b5d9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.459843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745149-204d-44b1-8235-b119688c9d11 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.489352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.489992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.490272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.490551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.491283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:08.491587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.493043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850774e7-2497-4a71-8fe8-8616d32c001f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.496404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.497070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.497352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.497623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.498361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:08.498665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.500057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.501276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 140/276] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:08.502518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da78f-6219-4e7b-8091-e58756ee84e8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.502802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da78f-6219-4e7b-8091-e58756ee84e8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.503074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8da78f-6219-4e7b-8091-e58756ee84e8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.504761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 141/277] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:08.507336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1d4e-96e6-44bb-be9f-e93cea8ab635 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.507622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1d4e-96e6-44bb-be9f-e93cea8ab635 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.507895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b1d4e-96e6-44bb-be9f-e93cea8ab635 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.509815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 142/278] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:08.513240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 137/279] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.513596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86529e-6016-4eca-b20f-1819b1d758fa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.513884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86529e-6016-4eca-b20f-1819b1d758fa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.514076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.514237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86529e-6016-4eca-b20f-1819b1d758fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.530574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9d86529e-6016-4eca-b20f-1819b1d758fa None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:08.531675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9d86529e-6016-4eca-b20f-1819b1d758fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:08.547770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.596831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 143/280] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:08.598074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.598358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.598629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.614513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:08.615678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:08.618576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5814-391d-4652-9b1b-84870226f09a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.652231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.653117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.653400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.653673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] PATH_INFO: `/v3/users/67a00c504b164e4fb87673782a3c4ea2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.654874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] RBAC: Authorizing `identity:get_user(user_id=67a00c504b164e4fb87673782a3c4ea2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.656371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.657994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 138/281] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/users/67a00c504b164e4fb87673782a3c4ea2 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.660652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.677487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.683207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 144/282] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:08.684377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.759883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbef31-e81b-436e-9e36-7ddf287c212d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.767478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.785605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6ec56-52a8-491a-ba3e-b41aa5933c44 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.794099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.794973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.795253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.795524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] PATH_INFO: `/v3/users/0af546e41432475e8b8a91d78ea32153` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.809099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] RBAC: Authorizing `identity:get_user(user_id=0af546e41432475e8b8a91d78ea32153)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.810619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.812333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 139/283] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/users/0af546e41432475e8b8a91d78ea32153 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.813092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.823636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.824465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.824745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.825012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.826165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.827596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.829225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 145/284] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.829960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.891661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.921090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8d62-891f-4ae1-b0f9-db8c35673d29 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.929893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14075def-f82a-499b-bea8-e6717660bd23 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.954635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.955494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.955773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.956034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.957381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.958892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.960586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 140/285] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:08.961894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:08.964078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.965061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.966092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.966369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.977526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:08.985311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:08.986213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:08.987026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 146/286] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:08.987693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.000829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.061899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5834e-87dc-4aec-a5b5-ffe2da882a13 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.085676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60587a25-e503-489d-93a1-b3f3bc3fa2db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.096070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.096740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.097022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.097300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.098115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, user.id=0af546e41432475e8b8a91d78ea32153, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:09.098423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.099874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.105481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 141/287] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 19 11:57:08 2022] GET /identity/v3/role_assignments?user.id=0af546e41432475e8b8a91d78ea32153&scope.system=all&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:09.106230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.109506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.132818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.133560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.133846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.134121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.134854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.136387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.216055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16568ae8-5609-45ea-8f22-e125bb687014 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.241261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 147/288] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:08 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:09.247697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.270305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.271929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.272936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.273410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/67a00c504b164e4fb87673782a3c4ea2/roles/ab23f5d906bb4ff8bc9b69169b17fe4a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.275909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, user_id=67a00c504b164e4fb87673782a3c4ea2, role_id=ab23f5d906bb4ff8bc9b69169b17fe4a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.277987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.333495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.377624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f916-6a0e-49cf-a077-d9a772d0463e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.412666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.413351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.413633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.413902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.415302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:09.415604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.417046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.426656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 148/289] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:09.432939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.455293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 142/290] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:09 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/users/67a00c504b164e4fb87673782a3c4ea2/roles/ab23f5d906bb4ff8bc9b69169b17fe4a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:09.546243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f039b-77c3-4486-89e1-2084d7bf349c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.576165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.585541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.586885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.587163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.587433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] PATH_INFO: `/v3/users/60da124d454443aeaad3bd363b5d88d2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.588764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] RBAC: Authorizing `identity:get_user(user_id=60da124d454443aeaad3bd363b5d88d2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.590249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.592315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 149/291] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:09 2022] GET /identity/v3/users/60da124d454443aeaad3bd363b5d88d2 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:09.597715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.678356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.720174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4f21-0f4d-4ff3-9f3e-90b5f98821f4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.756668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.757315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.757595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.757868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.828245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.829724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.898507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:09.941694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 143/292] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:09.947527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:10.075900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af143-aca6-44f3-9c97-2e2aeff0e307 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:10.123967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:10.124862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:10.125142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:10.125409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:10.126581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:10.128335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8199a16-5390-400b-82f4-23c6d3aedf06 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:10.130329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 150/293] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:09 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:10.135766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:10.277735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5111-3925-435e-b9dd-e4aa694c1c73 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:10.316729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:10.317387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:10.317665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:10.317935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:10.323921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=60da124d454443aeaad3bd363b5d88d2) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:10.323921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:10.323921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83426-3bf1-4559-818b-e8979cff6ac7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:10.327301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 144/294] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:10 2022] GET /identity/v3/role_assignments?user.id=60da124d454443aeaad3bd363b5d88d2&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:11.538167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e86-719e-4782-a550-24ccfa70da75 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.539019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e86-719e-4782-a550-24ccfa70da75 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.540003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e86-719e-4782-a550-24ccfa70da75 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.541772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 151/295] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:11.547268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.548088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.548608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.566162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:11.567667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:11.592672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:11.637206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 145/296] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:11.661033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744e86-719e-4782-a550-24ccfa70da75 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:11.726625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:11.772871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744e86-719e-4782-a550-24ccfa70da75 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:11.811504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:11.812326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.812609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.812883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.823373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-adf75c0b-cd43-41a3-9d88-857925f47a53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:11.831039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:11.831926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:11.833162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 152/297] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:11.838684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:11.950442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ce27-f1fd-484c-bd5e-d7bb43d78fb5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:11.973832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c45c9-8367-4750-a7fb-d172d4d555cd None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.974144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c45c9-8367-4750-a7fb-d172d4d555cd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.974460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c45c9-8367-4750-a7fb-d172d4d555cd None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.975961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 153/298] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:11.981585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fdbd-a578-400e-a9ff-78948af215d0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.982205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fdbd-a578-400e-a9ff-78948af215d0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.982689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fdbd-a578-400e-a9ff-78948af215d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.986743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:11.987411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:11.987691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:11.987962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:11.988744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:11.989045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:11.990432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.001382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 146/299] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.002564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4072fdbd-a578-400e-a9ff-78948af215d0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:12.004307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4072fdbd-a578-400e-a9ff-78948af215d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.004613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.027411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.083101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 154/300] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:12.084824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13b4a-088a-48d8-be0a-eaa72b9d2647 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.085109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13b4a-088a-48d8-be0a-eaa72b9d2647 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.085381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13b4a-088a-48d8-be0a-eaa72b9d2647 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.091370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 155/301] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:12.091370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6298c4-42b5-453a-b136-1f501950f1f2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.091370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6298c4-42b5-453a-b136-1f501950f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.091370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6298c4-42b5-453a-b136-1f501950f1f2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.091370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 156/302] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:12.094277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.094582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.094857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.111341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:12.112541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.118062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55a9a8-9745-4267-9e2b-4672f4d4078d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.151294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.152151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.152455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.152723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] PATH_INFO: `/v3/users/0af546e41432475e8b8a91d78ea32153` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.153891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] RBAC: Authorizing `identity:get_user(user_id=0af546e41432475e8b8a91d78ea32153)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.155310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11dea3-185d-4993-a9e1-47dda0f8693c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.156932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 147/303] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/users/0af546e41432475e8b8a91d78ea32153 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:12.158116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.158397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.158663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.160716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.176411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:12.177572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.178815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 157/304] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:12.179627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.244038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 148/305] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:12.244885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.263146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.281700 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bc16-d4bd-4eb2-97c3-c743c3dc29d9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.315810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.316618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.316903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.317173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.327826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:12.335482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:12.336725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:12.337529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 158/306] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:12.338181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.347546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3cf9a-c2bf-4f19-8e40-22873c751356 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.380424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.381285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.381565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.381838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] PATH_INFO: `/v3/system/users/0af546e41432475e8b8a91d78ea32153/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.383391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0af546e41432475e8b8a91d78ea32153, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.384754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.384860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.436640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ec7df-98fe-4da7-b915-4c08699f0d19 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.451236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 149/307] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 19 11:57:12 2022] PUT /identity/v3/system/users/0af546e41432475e8b8a91d78ea32153/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:12.452206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.483070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.483992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.484361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.484636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.485895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.487378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.489401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 159/308] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.490098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.552576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.572216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea284e30-7a17-4bbc-bfd5-e4d475ee0782 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.601263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d0d51-6ce7-4395-909e-8461bcd6c4c2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.607488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.608324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.608595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.608860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.617018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.621138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:12.629836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:12.634234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 150/309] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:12.635223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.649617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.650753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.651297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.651576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.652569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:12.652887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.654564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.663080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 160/310] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.668350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.741373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b233db-4cef-420b-af90-61a1a21843af None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.773282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc999c1-07fc-4550-9a29-7ff926675d3b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.775635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.776334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.776618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.776891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] PATH_INFO: `/v3/groups` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.777574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.779040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.808278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.808853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.809138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.809411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.810175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:12.810471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.811823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.819697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 161/311] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.821179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.856230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 151/312] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 19 11:57:12 2022] POST /identity/v3/groups => generated 229 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:12.856230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.857784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.876845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.953906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3dcb-a5d4-48e5-8617-18cd9477be1a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.987685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f788-3f42-472b-9fdb-edfb075d1678 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.998663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.000091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.000429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.001119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] PATH_INFO: `/v3/users/67a00c504b164e4fb87673782a3c4ea2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.002759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] RBAC: Authorizing `identity:get_user(user_id=67a00c504b164e4fb87673782a3c4ea2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.005088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.007405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 162/313] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/users/67a00c504b164e4fb87673782a3c4ea2 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:13.017313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.034597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.035929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.036403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.036811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] PATH_INFO: `/v3/users/76f7ef57fd5846cf9508618ffd941e41` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.056620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] RBAC: Authorizing `identity:get_user(user_id=76f7ef57fd5846cf9508618ffd941e41)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.058586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.061046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 152/314] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/users/76f7ef57fd5846cf9508618ffd941e41 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:13.067224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.135944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.151450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0dc6-0292-40db-ad16-d5bec25eb74f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.156616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.179122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c7f8-48b1-4b0e-bf26-d65f4bf1d5db None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.199371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.200031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.203045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.203275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.225146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.226683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.227220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.227643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.228719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, user.id=76f7ef57fd5846cf9508618ffd941e41, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:13.229165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.231566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.239219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 153/315] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/role_assignments?user.id=76f7ef57fd5846cf9508618ffd941e41&scope.system=all&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:13.285143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.286856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.402009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 163/316] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:13.409333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.518926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6111ce-8ac0-468b-8317-b0e96608f9b3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.544890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.556722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.558344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.558789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.561132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.561132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.562299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df014a2-76ed-44c9-969f-bb06ffebaf23 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.564556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 154/317] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:13.571205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.580590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.675513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50df9-34f5-49d7-81a6-a2f9df5a13fb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.711803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.712838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.713366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.713860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.714933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf, user.id=67a00c504b164e4fb87673782a3c4ea2) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:13.715443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.717113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc2ea-7d82-4aaa-b1a4-bbcdd2cad85e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.723845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 164/318] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/role_assignments?user.id=67a00c504b164e4fb87673782a3c4ea2&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:14.696797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb710ba-3ced-452e-8402-e2451458372e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:14.697282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb710ba-3ced-452e-8402-e2451458372e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:14.697282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb710ba-3ced-452e-8402-e2451458372e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:14.698660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 155/319] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:14.703742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:14.704123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:14.704332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:14.721170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:14.722351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:14.783295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:14.789332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 165/320] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:14.812374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb710ba-3ced-452e-8402-e2451458372e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:14.917554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb710ba-3ced-452e-8402-e2451458372e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:14.952218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:14.952932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:14.953208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:14.953472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:14.964045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:14.971684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:14.972775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:14.973564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 156/321] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:14.979921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.082786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823edb35-f206-4a26-ab65-e76696ec82b8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.116535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.117225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.117501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.117766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.118492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:15.118787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.120135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601dd21-d6f7-45c9-9c36-93b079a70788 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.128236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 166/322] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:15.134382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.187472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.202659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619e2c-c80a-4fc8-952a-1c1eb4b0ef9f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.202916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619e2c-c80a-4fc8-952a-1c1eb4b0ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.203158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619e2c-c80a-4fc8-952a-1c1eb4b0ef9f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.204555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 167/323] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:15.209345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.209632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.209909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.226209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:15.227950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:15.236474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d8bf5-61b5-4385-8c97-6adcb7a37072 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.273977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.274213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.274477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.274750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] PATH_INFO: `/v3/users/0af546e41432475e8b8a91d78ea32153` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.276047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=0af546e41432475e8b8a91d78ea32153)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.277662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.279845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 157/324] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/users/0af546e41432475e8b8a91d78ea32153 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:15.285867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.298959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.311325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 168/325] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:15.334199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.408916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a0fa-b3e7-44cf-a620-c50c18d46ec0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.430363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.437826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374e1a2-9e96-40b3-8ea3-282b9b48eb5a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.444826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.445701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.445808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.446072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.446887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] RBAC: Adding query filter params (role.id=b736f5f03a2c4dcb85ab86db9885a955, user.id=0af546e41432475e8b8a91d78ea32153, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:15.447195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.448674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee10898-f621-45b5-81bf-d56b679d4728 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.468255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 158/326] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/role_assignments?user.id=0af546e41432475e8b8a91d78ea32153&scope.system=all&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:15.468255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7032-ca77-46de-baac-de17d276f3d0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.468255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7032-ca77-46de-baac-de17d276f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.468255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7032-ca77-46de-baac-de17d276f3d0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.468255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 159/327] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:15.470971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.471267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.471526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.477784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.478605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.478895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.479142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.482436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.484576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.487415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 169/328] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:15.490993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:15.492785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:15.496399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.560774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.573574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 160/329] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:15.596168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.613788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536770f-ef58-4153-b453-d77dbc025f98 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.659192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.659826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.660103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.660404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] PATH_INFO: `/v3/groups` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.661085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.662524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.705036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a94f-6983-4d92-91d2-4a08f9472ee3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.714215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.737371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.738100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.738375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.738641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.749083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:15.756764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:15.757853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:15.759073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 161/330] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:15.763554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.857533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd297-5ccb-4c2e-afc0-25db04ee4fc7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.868518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 170/331] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 19 11:57:15 2022] POST /identity/v3/groups => generated 226 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:15.896644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.901422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.914789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 162/332] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:15.916020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.019339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09cf6-75ec-4356-a2b9-3ec6cf1d21ce None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.036475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:16.053892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.055369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.055659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.055931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] PATH_INFO: `/v3/users/76f7ef57fd5846cf9508618ffd941e41` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.057164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] RBAC: Authorizing `identity:get_user(user_id=76f7ef57fd5846cf9508618ffd941e41)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.058604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636772-7181-4c17-9784-bf457262d825 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.060948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 171/333] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/users/76f7ef57fd5846cf9508618ffd941e41 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:16.065895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.097618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:16.171618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749301-0bb6-4a31-ae66-f4cd91e1aef0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.208228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.209126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.209404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.209676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] PATH_INFO: `/v3/system/users/76f7ef57fd5846cf9508618ffd941e41/roles/ab23f5d906bb4ff8bc9b69169b17fe4a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.211158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=76f7ef57fd5846cf9508618ffd941e41, role_id=ab23f5d906bb4ff8bc9b69169b17fe4a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.212580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3bcc-a2ff-4519-b4ed-79cf78dafbbf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.280827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 163/334] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 19 11:57:16 2022] PUT /identity/v3/system/users/76f7ef57fd5846cf9508618ffd941e41/roles/ab23f5d906bb4ff8bc9b69169b17fe4a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:18.832812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb37e4-67e5-45c5-ba2d-7b10e2ae921d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.833519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb37e4-67e5-45c5-ba2d-7b10e2ae921d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.833519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb37e4-67e5-45c5-ba2d-7b10e2ae921d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.834698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 172/335] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:18.840096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.840982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.841450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.863817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:18.865358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:18.919614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1842ae-a0b7-499e-922f-eb0188f1001e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.920289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1842ae-a0b7-499e-922f-eb0188f1001e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.920786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1842ae-a0b7-499e-922f-eb0188f1001e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.922618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 173/336] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:18.927315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f831f-79a6-4d19-907c-eaa50a163446 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.927836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f831f-79a6-4d19-907c-eaa50a163446 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.928385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f831f-79a6-4d19-907c-eaa50a163446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.949488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 164/337] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:18.960075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-171f831f-79a6-4d19-907c-eaa50a163446 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:18.961625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-171f831f-79a6-4d19-907c-eaa50a163446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:18.993082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.036315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.085892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 174/338] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:19.090079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a259b-479a-4eee-9634-5f7416a681d4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.090565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a259b-479a-4eee-9634-5f7416a681d4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.090990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a259b-479a-4eee-9634-5f7416a681d4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.092499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 175/339] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:19.099189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.104811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.104811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.135118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:19.136391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:19.200825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05ae6-15a8-4264-823e-aa86e0f42934 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.228572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 176/340] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:19.229439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.269508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.270317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.270604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.270877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.277520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.293190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:19.300964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:19.302049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:19.303037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:19.309497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 165/341] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:19.310496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.338526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c299b3-5f99-45f9-86f4-c75ac590cfe5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.389060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.389893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.390170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.390436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.406237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:19.418363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:19.419553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 177/342] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:19.420547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.455957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.459827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241da6-45a6-42c0-922c-444f6d9f0a14 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.530337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.531151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.531428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.531753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.537566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d554-6397-40fc-bd71-1047abfa59d0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.545356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.558201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:19.571479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:19.572476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:19.573275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 166/343] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:19.573957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.579680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.580493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.580669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.580900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.582053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:19.583107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.583725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.599103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 178/344] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.599842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.714049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3120fa-808b-4266-a78d-6f3aafa9fc4b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.728021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4666-9d06-457c-8046-ff0ecb0ca0b9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.752476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.753156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.753437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.753711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.754568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:19.754978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.756402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.763071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.763738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.764014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.764333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.765073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:19.765372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.766734 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aeb70-f658-4b41-ad72-9f37f5d5e72d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.766986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 167/345] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.767825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.776936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 179/346] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.778338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec253c-b14b-4a4e-84e7-92310302e037 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.778625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec253c-b14b-4a4e-84e7-92310302e037 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.778899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec253c-b14b-4a4e-84e7-92310302e037 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.780390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 180/347] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:19.781182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec253c-b14b-4a4e-84e7-92310302e037 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.782431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.814475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.890835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc15a1-8e91-48b0-aa10-dc7a44656e96 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.892881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec253c-b14b-4a4e-84e7-92310302e037 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.930192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.930663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.931125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.931573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.931706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.931991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.932295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.932802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.004941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.006820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.008976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.010892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc331917-b80c-49bb-a113-a1581326c4a7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.020551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.041235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.118979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 181/348] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:20.119736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.141588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 168/349] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:20.143875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.144155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.144448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.166058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:20.167365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:20.256354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78715de-ccce-4a4a-a098-28abcd970ddf None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.259040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 169/350] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:20.260909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.291922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.298814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.299686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.300493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.306871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.306871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.375167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17ea5-2a82-4dd9-a04b-a02f00b050d4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.396688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.398087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924fe6-3e52-4522-ba70-c8f201014bc3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.416424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.417338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.417621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.417890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.419078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.420543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.422209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 170/351] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:20.422969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.516730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 182/352] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:20.518060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601841-4ca8-42b6-9c39-860fcafedd4b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.518348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601841-4ca8-42b6-9c39-860fcafedd4b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.518624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601841-4ca8-42b6-9c39-860fcafedd4b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.520031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 183/353] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:20.521029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da54a8-a7f7-4f32-bc12-16d2cd84efbf None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.521306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da54a8-a7f7-4f32-bc12-16d2cd84efbf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.521575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da54a8-a7f7-4f32-bc12-16d2cd84efbf None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.522793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 184/354] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:20.523549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da54a8-a7f7-4f32-bc12-16d2cd84efbf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.540922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbbd-e6ec-4f62-8955-fd6030841534 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.543498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.558098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.577285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.578569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.579366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.579727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.581393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.587169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.587169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 171/355] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:20.587169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.649106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da54a8-a7f7-4f32-bc12-16d2cd84efbf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.691265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.692472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.692472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.692639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.704481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:20.705609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ede6d-c7b3-4d2b-a615-da059a6e8320 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:20.713145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:20.714025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:20.714820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 185/356] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:20.715487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.750231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.751094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.751378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.751656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.759507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.761072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ace98-8778-4995-af93-b83aa30ac2d7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.762770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 172/357] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:20.763950 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4b2cc-043b-4fc9-8128-a9683e3d3791 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.768267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4b2cc-043b-4fc9-8128-a9683e3d3791 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.768651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4b2cc-043b-4fc9-8128-a9683e3d3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.788485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-32c4b2cc-043b-4fc9-8128-a9683e3d3791 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:20.790003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-32c4b2cc-043b-4fc9-8128-a9683e3d3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:20.814782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.823528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:20.826181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0a19-4264-4ab6-89df-8abc9c039062 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.867637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.868135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 173/358] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:20.873115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.873115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.873115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.873361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.873361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.873361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.881027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.882503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.884655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 186/359] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:20.885462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.887079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:20.888286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:20.966038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 174/360] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:20.967822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.004546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fd1e-2cf4-4cbf-9947-da73acb673de None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.042928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.044118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.044489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.044768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.047477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.048938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.052323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 187/361] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.052323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.080117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.083846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.086502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0a8b-80c3-4fd8-89e4-0d8bf5a221d9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.126621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.126621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.126876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.127052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.128356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:21.128356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.129597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.144256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 175/362] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.144256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.174655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703308d6-72ac-4bb2-a218-e118dc9bc11b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.222624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.223369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.223655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.223940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.225322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:21.225643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.227659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.234886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 188/363] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.242363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.275232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409592b-8f43-436c-ac43-315dc2f543ea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.314218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.315144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.315430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.315704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.317127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.318806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.322751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 176/364] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.323627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.365056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.393505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.406463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5db0-498f-4055-907e-3264e33fd0b1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.449708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.450511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.450795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.451067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.464851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:21.469974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be281-3f59-4862-aebf-9e1c4fbeaafa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:21.473689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:21.474808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 189/365] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:21.475852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.521679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.522737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.523723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.524152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.535463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:21.544258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:21.545214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:21.545997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:21.546602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 177/366] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:21.547337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.609588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafb67-da9e-4224-a8d0-b6dbac7cebd4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.646808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.647462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.647747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.648022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.649436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:21.649748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.651202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.664235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 190/367] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.664235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.669689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.680053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.687905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c2aa-7393-468b-8562-9620dc2a9113 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.735254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.736244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.736638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.737019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] PATH_INFO: `/v3/users/76f7ef57fd5846cf9508618ffd941e41` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.738481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] RBAC: Authorizing `identity:get_user(user_id=76f7ef57fd5846cf9508618ffd941e41)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.740106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.742193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 178/368] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/users/76f7ef57fd5846cf9508618ffd941e41 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.743109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.786264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d560-75ef-4b9f-b20e-1cdbf0624846 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.843026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.843695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.844000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.844545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.845931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:21.846248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.848302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.856136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 191/369] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.857526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.875374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271888-5329-4e36-a580-bf47b3e02d8e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:21.917257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:21.918284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:21.918749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:21.919257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:21.920462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:21.920779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:21.922232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:21.932758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 179/370] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:21.933826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:21.955764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:21.972171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.012617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa54a-8862-487e-b33c-293990104de4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.079769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.080509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.080744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.081020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.081766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:22.082132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.083758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.087308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30cb5-bfd0-4b79-bf99-6d3cdcf1a815 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.093965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 192/371] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:22.094885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.125253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.126349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.126830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.127293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.128338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] RBAC: Adding query filter params (role.id=ab23f5d906bb4ff8bc9b69169b17fe4a, user.id=76f7ef57fd5846cf9508618ffd941e41, scope.system=all) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:22.128859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.130603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.143620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 180/372] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 19 11:57:21 2022] GET /identity/v3/role_assignments?user.id=76f7ef57fd5846cf9508618ffd941e41&scope.system=all&role.id=ab23f5d906bb4ff8bc9b69169b17fe4a => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:22.144778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.229391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.257999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7812f-be79-4f5e-8a3b-456716428491 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.296166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.297214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.297747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.298232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.378153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.379967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.382538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc29c-d4a3-421a-818f-7c7876f959d2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.462818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.469503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.470145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.470428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.470699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.487053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.510003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 181/373] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:22.517078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.572381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.573969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.700443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1add9-7b24-4aea-b83f-c96979c8009c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.720311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 193/374] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:22.726167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.775242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.792918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.793786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.794072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.794354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.797263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.797263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.798777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 182/375] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:22.804382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.869260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946082-2f5a-4300-9ba7-b3abeb2ca573 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.886772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.931786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.933031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.934426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.935811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] PATH_INFO: `/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.937302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ae3e54b6083e4b39ac3a5ef049d34d8c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.939088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.943000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 194/376] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:22.948813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.999274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84e16-d58d-4a38-9199-3b1bdd1f994f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:23.069599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:23.070885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.072476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.072947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.075962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:23.079250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:23.086827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 183/377] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:23.092093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:23.132683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8d06-d0c7-4bd3-bc55-bd76a060c9c3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:23.144611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:23.172447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:23.173733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.174256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.174718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] PATH_INFO: `/v3/groups/7d596a375b7f487cbf7c00f1f4e83395` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.184161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] RBAC: Authorizing `identity:get_group(group_id=7d596a375b7f487cbf7c00f1f4e83395)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:23.186054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:23.188363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 195/378] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/groups/7d596a375b7f487cbf7c00f1f4e83395 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:23.195943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:23.297167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e95d-6d81-475d-b6cd-e2882c1d7bd5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:23.315039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:23.368325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:23.368982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.369261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.369531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.370352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:23.370657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:23.372097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec28bd7-a344-418b-8540-eb8337157a62 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:23.387695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 184/379] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:23 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:23.390732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce2a2-cc2d-471c-9b5e-b00edc57e13b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:23.438900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:23.439567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.439849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.440128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.440985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] RBAC: Adding query filter params (group.id=7d596a375b7f487cbf7c00f1f4e83395, role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=ae3e54b6083e4b39ac3a5ef049d34d8c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:23.441296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:23.442722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28837f7-b848-4983-9a09-26703dfd4a05 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:23.453382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 196/380] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:23 2022] GET /identity/v3/role_assignments?group.id=7d596a375b7f487cbf7c00f1f4e83395&scope.project.id=ae3e54b6083e4b39ac3a5ef049d34d8c&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:23.856420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fcba-d44d-46f0-acc6-705eaf999f1e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.856784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fcba-d44d-46f0-acc6-705eaf999f1e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.856973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fcba-d44d-46f0-acc6-705eaf999f1e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.858591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 185/381] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:23.863453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:23.863736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:23.864009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:23.890084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:23.891267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:23.921145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:23.975877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 197/382] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:24.003078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219fcba-d44d-46f0-acc6-705eaf999f1e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.131820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219fcba-d44d-46f0-acc6-705eaf999f1e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:24.179677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:24.180507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.180786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.181056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.198959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:24.206844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:24.207717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:24.208778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 186/383] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:24.213866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.354277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06fc17-c74f-45d3-846e-1c211f257926 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:24.389512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:24.391117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.391117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.391117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.391455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:24.391689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:24.393073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be08b-8e14-4de3-bf01-02e731f07b02 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:24.402553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 198/384] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:24.407757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.478429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:24.497377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912f7-6244-460c-94b6-1c26d0435c64 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.502657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912f7-6244-460c-94b6-1c26d0435c64 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.502657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912f7-6244-460c-94b6-1c26d0435c64 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.502657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 199/385] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:24.504644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.504932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.505213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.529359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:24.530546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:24.565457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:24.595763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0054-664a-44fd-b428-9ba419c72a6c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:24.640768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:24.641647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.641928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.642200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.644385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:24.645825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:24.647452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 187/386] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:24 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:24.653913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.672111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 200/387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:24.697649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.813072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7768b6-d82f-408f-b49c-15492b77a549 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:24.815047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:24.853620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:24.854085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce886-b638-449c-8bbe-0b30a35389e1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:24.854480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.854755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.855027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.856231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:24.858769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6af0f-b182-4b04-b881-a493a92a3f9b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:24.864348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 188/388] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:24 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:24.865842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406803-2aaf-4ef4-b982-35120a7c58f9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.866128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406803-2aaf-4ef4-b982-35120a7c58f9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.866402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406803-2aaf-4ef4-b982-35120a7c58f9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.867831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 189/389] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:24.870328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406803-2aaf-4ef4-b982-35120a7c58f9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:24.898748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:24.899466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.899744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.900013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.910704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-81f15ffb-2678-4056-9ded-a34b97660ed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:24.919456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:24.920634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:24.921439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:24.924497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 201/390] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:24.925745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.926033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.926298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.943726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:24.945521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:24.959591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:25.014386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406803-2aaf-4ef4-b982-35120a7c58f9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.024224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 202/391] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:25.024224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.066789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.067658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.067932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.068210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/groups/492d71b776a54d2b83be919235aa01d0/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.070684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, group_id=492d71b776a54d2b83be919235aa01d0, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.072171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.146186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350bc8-60ee-4c45-9488-c99b6612a411 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.160301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 190/392] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 19 11:57:24 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/groups/492d71b776a54d2b83be919235aa01d0/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:25.160301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.200586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:25.233155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.235448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.235922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.236432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.237392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:25.237883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.239440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.260609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 203/393] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:25.266012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.286320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b295-7a71-4c0c-bf8d-ea26c8e399d0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.294135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:25.332743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.333659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.334039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.341058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.354735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:25.363891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:25.365033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:25.366071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:25.369214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 191/394] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:25.376354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.478702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c22f7-139e-4ad1-8bb3-26061bd3aa96 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.509506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:25.515894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.516961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.517381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.517813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.519120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.519420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b38b-7681-4c36-b7e1-d5e0ca423f98 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.520877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.522861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 204/395] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:25.528951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.568664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.569342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.570503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.570783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.571696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:25.572014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.573433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.583569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 192/396] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:25.590807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.680477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:25.723628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ef0c6-499a-47bb-9b6b-f0cab8308607 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.776599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0268-765f-43b3-a1cb-71c723bf8a17 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.809102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.809967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.810244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.810516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.812466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.813904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.815613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 205/397] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:25.822819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.837293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.838165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.838445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.838717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.841941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.843461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.845127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 193/398] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:25.850453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.888877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.005759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66188a17-30a1-47f8-b7c1-9d6a5c443762 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.048476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d630bb-1370-4ca1-87a6-5499f50b63ac None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.055630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.056578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.056863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.061306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/groups/492d71b776a54d2b83be919235aa01d0/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.065531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, group_id=492d71b776a54d2b83be919235aa01d0, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:26.066976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790646b-ca1a-4d5c-bb34-8474186c5d56 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:26.097016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.097927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.098214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.098486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.099795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:26.101546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:26.103798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 194/399] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:25 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:26.111087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.150222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 206/400] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 19 11:57:25 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/groups/492d71b776a54d2b83be919235aa01d0/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:26.219325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ac02-08c4-45a6-9746-f45b7e294a84 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.219654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ac02-08c4-45a6-9746-f45b7e294a84 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.219862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ac02-08c4-45a6-9746-f45b7e294a84 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.224227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 207/401] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:26.227404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc230-f550-42d8-b5c4-c4a89a51c74c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.227691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc230-f550-42d8-b5c4-c4a89a51c74c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.227972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc230-f550-42d8-b5c4-c4a89a51c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.239669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.244053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.252746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7b5fc230-f550-42d8-b5c4-c4a89a51c74c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:26.253984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7b5fc230-f550-42d8-b5c4-c4a89a51c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:26.268069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed13666-db43-44d0-9db2-3a65fdabfce1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.319001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.322150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.322150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.322150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/groups/492d71b776a54d2b83be919235aa01d0/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.328507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7b7ced9cc64edabfdbf593c7c1844c, group_id=492d71b776a54d2b83be919235aa01d0, role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:26.328507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:26.361118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 208/402] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:26.362428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe6-55a0-4696-a9b3-53eb780b0d83 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.362765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe6-55a0-4696-a9b3-53eb780b0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.363041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe6-55a0-4696-a9b3-53eb780b0d83 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.364529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 209/403] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:26.370501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83807e5-e524-463d-a13d-b051142be418 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.371025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83807e5-e524-463d-a13d-b051142be418 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.371551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83807e5-e524-463d-a13d-b051142be418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.391868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b83807e5-e524-463d-a13d-b051142be418 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:26.393217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b83807e5-e524-463d-a13d-b051142be418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:26.443706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 195/404] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 19 11:57:26 2022] PUT /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c/groups/492d71b776a54d2b83be919235aa01d0/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:26.450446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.494312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 210/405] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:26.541849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83807e5-e524-463d-a13d-b051142be418 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.629777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf6c8-4413-4257-85d7-c818692ce465 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.636582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.677936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83807e5-e524-463d-a13d-b051142be418 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.720117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.721467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.721943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.722701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.728900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.729708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.729994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.730263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.739468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:26.748614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:26.749514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:26.750402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 211/406] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:26.755617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:26.755823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:26.769405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:26.770333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:26.771131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:26.773487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 196/407] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:26.779930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.791459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.871304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe5b2-d0a4-4233-aad1-a42870e6e0a6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:26.897228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:26.908362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:26.910781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:26.910781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:26.910781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:26.910781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:26.911176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:26.912674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:26.922087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 212/408] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:26.928147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:26.940897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87675ec-1d70-41ef-a239-c76c923f2e64 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.004608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.005553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.005980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.006394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.007835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:27.008321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.009958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.031916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 197/409] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:27.036859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a824-3dde-455e-96b5-4e82b4634924 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.037966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.074323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.075381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.075755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.076121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] PATH_INFO: `/v3/groups/7d596a375b7f487cbf7c00f1f4e83395` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.077454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] RBAC: Authorizing `identity:get_group(group_id=7d596a375b7f487cbf7c00f1f4e83395)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.080885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.080885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 213/410] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:26 2022] GET /identity/v3/groups/7d596a375b7f487cbf7c00f1f4e83395 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:27.086347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.152666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.181035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.196409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426134-d443-4679-ab3c-02e1b5391141 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.234689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.235859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.237341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ee4c-b96f-4c5b-a6a2-58758068c8e6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.244999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.245559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] PATH_INFO: `/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.247852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ae3e54b6083e4b39ac3a5ef049d34d8c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.249585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.251718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 214/411] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:27 2022] GET /identity/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:27.257174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.305894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.306771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.307055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.307330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.312919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.314397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.316367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 198/412] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:27 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:27.325185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.368487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36930d-445b-49ae-8193-da8b93fca6f9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.404717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.405754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.406126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.406493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] PATH_INFO: `/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c/groups/7d596a375b7f487cbf7c00f1f4e83395/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.408738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] RBAC: Authorizing `identity:create_grant(project_id=ae3e54b6083e4b39ac3a5ef049d34d8c, group_id=7d596a375b7f487cbf7c00f1f4e83395, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.410332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b1e7-52f5-4384-b1c3-568bc87835ee None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.416567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.473953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a7ac7-fb72-46e8-a444-26ca464b2e72 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.512929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.513851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.514138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.514414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.515616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.517094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.519662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 199/413] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:27 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:27.526048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.535093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 215/414] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 19 11:57:27 2022] PUT /identity/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c/groups/7d596a375b7f487cbf7c00f1f4e83395/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:57:27.539809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.667023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac41145-6676-4d81-bcf9-b65739404c22 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.717599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.718499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.718783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.719064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/groups/492d71b776a54d2b83be919235aa01d0/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.725606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] RBAC: Authorizing `identity:create_grant(project_id=97053b712b9f4fd68aa01da5ffb658cf, group_id=492d71b776a54d2b83be919235aa01d0, role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.727246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.832102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481939-88d6-4fc8-ba72-09a091ac1d68 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.832749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481939-88d6-4fc8-ba72-09a091ac1d68 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.833217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481939-88d6-4fc8-ba72-09a091ac1d68 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.835063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 216/415] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:27.839764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.840268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.840773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.868358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 200/416] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 19 11:57:27 2022] PUT /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf/groups/492d71b776a54d2b83be919235aa01d0/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:57:27.870709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:27.871919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:27.971947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 217/417] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:28.009690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:28.086563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:28.140426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dea80f-a93d-43e8-bf1e-8fc64b2e6228 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:28.182331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:28.183145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:28.183428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:28.183697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:28.195271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:28.203097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:28.203966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:28.204811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 201/418] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:28.210190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:28.388972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478f46f-c50a-4497-ac93-368096ee1a18 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:28.415267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:28.441229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:28.441986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:28.442151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:28.442419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:28.443159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:28.443455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:28.444903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:28.460058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 218/419] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:28.466621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:28.588841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733179-b27c-44d4-9517-adecabd3106c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:28.625695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:28.635164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:28.635866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:28.642137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:28.642137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:28.716624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:28.718116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd0a8e-93fb-46e9-ab68-2811534a2936 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:28.849231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 202/420] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:28.854946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.023800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dc710-6732-4183-8480-61237cdd9b57 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.026557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ffca-8d55-4344-be54-e7b8b269eb2e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.026854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ffca-8d55-4344-be54-e7b8b269eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.027134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2ffca-8d55-4344-be54-e7b8b269eb2e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.032929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 203/421] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:29.040222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.040222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.040222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.068553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:29.069898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:29.072590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.073459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.073748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.074014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.075268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.076726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:29.078435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 219/422] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:28 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:29.083993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.124623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.141261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.186378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 204/423] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:29.222533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.235942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec120-ddd1-4bcb-b702-28d840544487 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.277224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.278675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.278975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.279241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.280900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.282673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a989f-707f-4e66-b918-0fdf21862d1b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:29.285474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 220/424] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:29.287010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6216-208a-4d28-a103-b5876c78800b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.287653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6216-208a-4d28-a103-b5876c78800b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.287938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6216-208a-4d28-a103-b5876c78800b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.290391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 221/425] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:29.294937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c6216-208a-4d28-a103-b5876c78800b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.365444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bf84b-d9fd-4c30-96ff-b93380af2d59 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.413304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.414771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.415523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.416414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.422547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c6216-208a-4d28-a103-b5876c78800b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.430966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:29.438711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e0e9b457-19ed-4151-b08c-ca0c7ad5a57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:29.443416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:29.444319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:57:29.445681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:29.448619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 205/426] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:29.453454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.453454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.453454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.468798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.469776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.470261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.470731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.472242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:29.472722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:29.473314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.474232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:29.475280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:29.484103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 222/427] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:29.486139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.490037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.561242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 206/428] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:29.588228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.628326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cbbeb-c142-4df0-a974-34a65fca718a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.682950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.683868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.684153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.684448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.686764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] RBAC: Adding query filter params (name=member) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:29.687074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.689481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:29.706455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 223/429] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:29.712689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.716049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab8782-2ddc-4d43-a0d5-336eff634104 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.778970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.779176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.779795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.780073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.780369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.796574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:29.807670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:29.808643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:29.809710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 207/430] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:29.815619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:29.826541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:29.860466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2184-e705-4cf2-95e4-ac5ca581b046 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.904219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.904834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.905118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.905395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.945833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf98f0-71ec-41d5-9dc5-d4d967cfd855 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:29.983601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.985079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:29.989627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:29.990312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.990597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.990868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.991654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:29.991959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:29.993438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.004915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 208/431] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.013015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.043631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.089204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.112030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 224/432] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:57:30.117639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.130242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca923-0929-491d-83d4-407f843ff4ef None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.175419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.176437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.177144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.177492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.237426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db9e3-84d4-409d-8415-19b578d41d50 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.260624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.262127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a80-d86a-473a-99b3-b8c5f58b41f5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.274194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.275049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.275427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.275721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.277039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.278488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68fc6e-bbe8-4152-b619-29950dd511d9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.280621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 225/433] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:30.281621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c7d7-5010-42e6-b133-b15ebd6e1486 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.281904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c7d7-5010-42e6-b133-b15ebd6e1486 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.282239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c7d7-5010-42e6-b133-b15ebd6e1486 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.287499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 226/434] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:30.287499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c7d7-5010-42e6-b133-b15ebd6e1486 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.296682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.342704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.379601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 209/435] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:30.380923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.381202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.381471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.398080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:30.399234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:30.406082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c7d7-5010-42e6-b133-b15ebd6e1486 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.440870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.441720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.441999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.442261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.443420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.444975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.446757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 227/436] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.447329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.473343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 210/437] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:30.474252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.548974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.575387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4759e-29af-45da-9f08-0284cd546b62 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.593388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.597454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef6a32-6fb7-46dd-b884-9c7d61e4ae10 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.610718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.611477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.611755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.612010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] PATH_INFO: `/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.613217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] RBAC: Authorizing `identity:get_project(project_id=6b7b7ced9cc64edabfdbf593c7c1844c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.614648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.621431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 228/438] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/projects/6b7b7ced9cc64edabfdbf593c7c1844c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.621431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.640603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.641258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.641559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.641810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.642635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=b736f5f03a2c4dcb85ab86db9885a955, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:30.642941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.644412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.650763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 211/439] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=b736f5f03a2c4dcb85ab86db9885a955 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.651701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.751234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ade5b-932a-4e7c-a682-82949cc1025f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.768152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e4566-1640-45f6-8666-f9799b41791c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.788185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.789552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.789828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.790094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.801877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:30.808038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.808922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.809197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.809461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-91de2a96-761f-4d46-aced-f5df729af552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:30.810621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:30.811481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:30.812719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:30.813531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.813531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.816859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 229/440] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:30.818135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1551-81fe-4d46-b802-f2e587ac8aa9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.818426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1551-81fe-4d46-b802-f2e587ac8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.818699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1551-81fe-4d46-b802-f2e587ac8aa9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.818794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 212/441] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.819670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.820112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 230/442] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:30.824459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1551-81fe-4d46-b802-f2e587ac8aa9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.827071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.858574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.939609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f346-464f-4d17-95fa-71a13f9aaea7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.944392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1551-81fe-4d46-b802-f2e587ac8aa9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.983786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.985332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.985332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.985332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.985882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:30.986188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.987672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.987791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.987876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.988117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.988431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.989243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:30.989548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.991014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19ad61-977a-416c-af2d-4dab216fb066 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.997085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 231/443] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=6b7b7ced9cc64edabfdbf593c7c1844c&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.998298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.998579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.999741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.999880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 213/444] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:31.004948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.019336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:31.020634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:31.101368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.109831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 232/445] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:31.120407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.129197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c1c3-7916-46af-9d6c-53c65db04a8b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.132762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.167006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.167661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.167938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.168246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.248818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.250353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.254305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654049-a409-499a-a5c1-16a9594c83ca None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.293928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.295091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.295366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.295632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.308468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:31.316668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:31.317568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:31.318365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 233/446] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:31.326552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.366124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.378710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 214/447] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:31.383380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.401859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.453222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3636-6750-480b-93e0-e215c81ad80b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.490340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.493359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.493359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.493359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.493359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:31.493359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.494063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.502404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 234/448] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:31.505606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5a01-bf57-4410-8158-8344cb865692 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.509539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.543492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.544423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.544735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.545011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] PATH_INFO: `/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.546291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] RBAC: Authorizing `identity:get_project(project_id=ae3e54b6083e4b39ac3a5ef049d34d8c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.548256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.551720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 215/449] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/projects/ae3e54b6083e4b39ac3a5ef049d34d8c => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:31.555877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.615334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.615784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40144b-b2b6-4426-902d-dfbd0d6ef13e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.639352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.649432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.650077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.650361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.650634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.655215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a761-06d4-4b03-ab36-909f24a72680 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.688494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.689346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.689628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.689903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] PATH_INFO: `/v3/groups/7d596a375b7f487cbf7c00f1f4e83395` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.691070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] RBAC: Authorizing `identity:get_group(group_id=7d596a375b7f487cbf7c00f1f4e83395)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.692545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.694142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 216/450] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/groups/7d596a375b7f487cbf7c00f1f4e83395 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:31.700343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.716871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.718316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.799153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fe0d-700e-40be-90c6-f1b24ab0e953 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.815812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 235/451] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:57:31.821363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:31.825378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.833139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.833784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.834075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.834368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.835724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] RBAC: Adding query filter params (group.id=7d596a375b7f487cbf7c00f1f4e83395, role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=ae3e54b6083e4b39ac3a5ef049d34d8c) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:31.836032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.837503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.839605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.843176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 217/452] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/role_assignments?group.id=7d596a375b7f487cbf7c00f1f4e83395&scope.project.id=ae3e54b6083e4b39ac3a5ef049d34d8c&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:31.925661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee502-9d7b-4179-b9aa-0af57924191a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:31.961392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:31.962257 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.962534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.962799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] PATH_INFO: `/v3/projects/97053b712b9f4fd68aa01da5ffb658cf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.963998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] RBAC: Authorizing `identity:get_project(project_id=97053b712b9f4fd68aa01da5ffb658cf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:31.965478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:31.967211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 236/453] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/projects/97053b712b9f4fd68aa01da5ffb658cf => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:31.972914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:32.074341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f999-8c66-4782-8046-4c1a70517eec None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:32.107511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:32.108394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:32.108683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:32.108959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] PATH_INFO: `/v3/groups/492d71b776a54d2b83be919235aa01d0` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:32.110110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] RBAC: Authorizing `identity:get_group(group_id=492d71b776a54d2b83be919235aa01d0)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:32.111551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aaf5d-587f-48da-a30b-16abd988a975 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:32.113182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 218/454] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 19 11:57:31 2022] GET /identity/v3/groups/492d71b776a54d2b83be919235aa01d0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:32.118987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:32.200440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:32.214671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabff75-01e5-4089-aea9-ea8dd20ce24e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:32.247064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:32.247697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:32.247974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:32.248331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:32.249144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] RBAC: Adding query filter params (group.id=492d71b776a54d2b83be919235aa01d0, role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=97053b712b9f4fd68aa01da5ffb658cf) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:32.249449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:32.250853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488bfca-437a-426e-b8da-2bbd595154c1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:32.256447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 237/455] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 19 11:57:32 2022] GET /identity/v3/role_assignments?group.id=492d71b776a54d2b83be919235aa01d0&scope.project.id=97053b712b9f4fd68aa01da5ffb658cf&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:34.993101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba1eb-c456-443d-9ee8-31478e52078b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:34.993644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba1eb-c456-443d-9ee8-31478e52078b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:34.993644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba1eb-c456-443d-9ee8-31478e52078b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:34.995294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 219/456] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:35.000091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ab57-0c5d-4f94-813f-0724f0cc2035 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.000493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ab57-0c5d-4f94-813f-0724f0cc2035 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.000654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ab57-0c5d-4f94-813f-0724f0cc2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.021124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d866ab57-0c5d-4f94-813f-0724f0cc2035 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:35.022299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d866ab57-0c5d-4f94-813f-0724f0cc2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:35.115274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 238/457] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:35.151571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ba1eb-c456-443d-9ee8-31478e52078b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.233692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.290674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ba1eb-c456-443d-9ee8-31478e52078b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.334746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194bfca-4d4f-41e3-91d1-9690af5008b9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.335466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194bfca-4d4f-41e3-91d1-9690af5008b9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.335935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194bfca-4d4f-41e3-91d1-9690af5008b9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.341915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 239/458] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:35.343356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fceca-5057-413a-a029-7b358d90b336 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.343857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fceca-5057-413a-a029-7b358d90b336 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.344368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fceca-5057-413a-a029-7b358d90b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.352791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.353593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.353875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.354150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.363839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-150fceca-5057-413a-a029-7b358d90b336 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:35.365436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-150fceca-5057-413a-a029-7b358d90b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:35.380047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.381561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:35.414067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:35.415008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:35.415856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:35.415856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:35.415856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:35.415856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:35.421452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 220/459] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:35.427655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.455062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 240/460] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:35.504096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb860a-4ee5-4a0d-8b53-7d06b197ff86 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.504827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb860a-4ee5-4a0d-8b53-7d06b197ff86 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.505331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb860a-4ee5-4a0d-8b53-7d06b197ff86 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.507802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 241/461] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:35.508796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb860a-4ee5-4a0d-8b53-7d06b197ff86 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.524641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.579197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ba22-ba69-474c-8c2f-2128b531884e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.593161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.614521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.615529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.616070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.617082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.617984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:35.618479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.620032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44eebd-d580-40d5-866d-8a3d9053e5a4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.633344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 221/462] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:35.634811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.635288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.635752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.644105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb860a-4ee5-4a0d-8b53-7d06b197ff86 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.655334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:35.656818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:35.693174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.693990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.694268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.694616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.709885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.712395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.740232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 222/463] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:35.740232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:35.744425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:35.745244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:35.746084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:35.746084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:35.746084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:35.746084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:35.746084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 242/464] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:35.752875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.832278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.870525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eb18d-1830-4b71-b4a2-2ef1251dc22c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.875958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e14ee-895b-40d5-a41e-9d826c4e662e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.877621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.909551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.910219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.910497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.910770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.911490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:35.911846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.913322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.913935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.914512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.914791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.915061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.915872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.917356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81769-8600-47b1-8bf3-a29556c9e397 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.925533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 243/465] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:35.926183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.026118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7d38-0129-4ddd-be14-f136dcfa09bd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.028107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 223/466] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:35 2022] POST /identity/v3/users => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:36.029938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9282c-de6e-4c02-8067-0ebb2d7644d8 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.030225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9282c-de6e-4c02-8067-0ebb2d7644d8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.030494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9282c-de6e-4c02-8067-0ebb2d7644d8 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.031742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 224/467] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:36.032571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9282c-de6e-4c02-8067-0ebb2d7644d8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.071107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.092517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.093259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.093539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.093810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.110397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.111862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b0792cc8-980a-4ccf-8121-f832b5d547d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:36.135921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:36.136909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:36.137778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:36.137778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:36.137778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:36.137778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:36.140367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 244/468] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:36.142024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.144045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.145243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.168371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:36.170245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:36.173241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9282c-de6e-4c02-8067-0ebb2d7644d8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.212218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.213311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.213790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.214254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.214964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.216932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.248152 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 245/469] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:36.248950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.305880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 225/470] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:36.307241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.333199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.371910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21146521-e953-4987-bf4a-cf8153e60ed4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.380117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.407708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.408554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.408836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.409105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.410467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:36.410773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.412838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.426422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 246/471] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.432890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.486425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e05b-19cc-43d7-8100-86713b0283ef None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.525416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.526222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.526500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.526777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.538720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.540350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6cdd1a0f-cf61-49c9-a486-dac604f5ff5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:36.560926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:36.561854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:36.562692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:36.562692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:36.562692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:36.562692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:36.562911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a24d0-97df-4eca-8c1a-2a4323705d70 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.562981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 226/472] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:36.563487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941eaa5-f8d1-4e92-9221-3643d660595c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.563648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941eaa5-f8d1-4e92-9221-3643d660595c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.568272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941eaa5-f8d1-4e92-9221-3643d660595c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.568272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 227/473] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:36.569286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941eaa5-f8d1-4e92-9221-3643d660595c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.613228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.613898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.614174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.620233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.620233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.620233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.652560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.687285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941eaa5-f8d1-4e92-9221-3643d660595c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.722202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.722851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.723136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.723406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.724116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:36.724444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.725931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3b220-536c-4374-8e18-930724c02e27 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.737426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 228/474] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.738811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.739098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.739369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.748069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 247/475] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:57:36.748992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.780910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.788221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:36.799543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:36.889891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769e45-35a8-413c-b78b-675a1877e057 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.909743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 229/476] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:36.930860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.931594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.931876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.932215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.932932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.934536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.944512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:37.014743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:37.016532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 248/477] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/users => generated 249 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:37.072022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0c37-64ae-4f4c-9a6f-e1ca49804053 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:37.112700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:37.113384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:37.113658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:37.113927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:37.114760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:37.116229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:37.153617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.sql.core [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:57:37.153617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:57:37.153617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [parameters: {'id': '9720af13c7334ae0a12c1ac606d499db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:57:37.153617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:57:37.172391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return ref.to_dict() May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:57:37.173367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application yield resource May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise self.value May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application session.commit() May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:57:37.174388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.flush() May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application compat.raise_( May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:57:37.175816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:57:37.176721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:57:37.177538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [parameters: {'id': '9720af13c7334ae0a12c1ac606d499db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:37.183926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:57:37.185993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:37.187976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 230/478] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:37.188120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:37.275449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:37.298470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b281fb-f81d-4cc8-b4a6-6897f22d8494 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:37.339308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:37.340268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:37.340431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:37.340691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:37.351664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a4cf2648-d676-4b0c-a874-04b2018079e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:37.360148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:37.362264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:37.364306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 249/479] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:37.368134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:37.476871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417529-6e5c-42f2-baac-9ad3d7fc39ef None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:37.497178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:37.516004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:37.519374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:37.519374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:37.519374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:37.519374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:37.519374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:37.519700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5cd1a-5435-4ede-bf69-dfb15e0385f1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:37.530565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 231/480] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:38.633005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce6de2-38e8-4b9b-8664-29ae799742c8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:38.633005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce6de2-38e8-4b9b-8664-29ae799742c8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:38.633005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce6de2-38e8-4b9b-8664-29ae799742c8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:38.633005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 250/481] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:38.639227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:38.639990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:38.640471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:38.657767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:38.659226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:38.742576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 232/482] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:38.783458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce6de2-38e8-4b9b-8664-29ae799742c8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:38.976868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce6de2-38e8-4b9b-8664-29ae799742c8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.031616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.032437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.032715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.032982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.046511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b38f72af-6964-495b-9ed3-1f26c51de3b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:39.054558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:39.055466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:39.056292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:39.056904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.060623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 251/483] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:39.068240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.160716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107380-5403-4a1e-995d-c61c4e17554a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.161099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107380-5403-4a1e-995d-c61c4e17554a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.161262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107380-5403-4a1e-995d-c61c4e17554a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.162778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 252/484] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:39.169180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.169437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.169709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.199252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:39.204564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:39.302932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299be7a9-dab7-4d8f-82c8-3c4efc62fe8a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.336593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.348872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 253/485] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:39.381527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.382306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.382583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.382853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.383599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:39.383896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.385302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.393024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.414066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 233/486] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:39.420336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.623394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a0b8d-ed82-45c1-b599-2c9e2e4054ba None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.657630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c3a3-3671-404d-92ce-2225c0d85ca2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.688566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.706665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.708103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.708103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.708103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.721595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.722695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.723139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.723593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.729702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:39.736517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d36febef-ff84-4ae3-a07b-ebe1b3409aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:39.737467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:39.738339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:39.739329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 254/487] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:39.740234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425ecc2-ed2a-4ace-bd6c-5f7c5652b86e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.741256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.744764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425ecc2-ed2a-4ace-bd6c-5f7c5652b86e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.744897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425ecc2-ed2a-4ace-bd6c-5f7c5652b86e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.746630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 255/488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:39.749311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425ecc2-ed2a-4ace-bd6c-5f7c5652b86e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-126cdf5d-5e84-4075-90ae-91e6c8f3e06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:39.766455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:39.767396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:39.768265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:39.768265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:39.768265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:39.768265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:39.768731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 234/489] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:39.770282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.770727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.771087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.789611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:39.791018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:39.813681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.860847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425ecc2-ed2a-4ace-bd6c-5f7c5652b86e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.877190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 235/490] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:39.878035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.898967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.899670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.900259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.900645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.901660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:39.902119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.903738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.914947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 256/491] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:39.916052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.969949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.006213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb130b8-6253-4ab2-bb13-f60eb1aef6d4 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.027619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828ecb7-a498-4071-b37a-b53dbc3d1b9a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.051775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.052998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.053443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.054555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.055684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.056129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.058600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.065297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.066221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.066601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.067295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.074032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 236/492] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:40.075084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.080234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:40.089456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.090508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:40.091468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:40.097094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 257/493] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.097094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.102326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.189350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01bc2-416f-4ed0-b720-2a9a4fd1d26d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.202136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ab45-3001-4bd5-9544-a84d4603200a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.212184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.224871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.225709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.225987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.226248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.236594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.237371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.237649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.237879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.237977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.239356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.245934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.247360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-59baa887-2458-4943-992c-323ee3efc356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:40.257198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.258137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.258992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:40.258992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:40.258992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:40.258992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:40.258992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 237/494] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.259658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53a5e-4d4e-45ba-a694-c56f6642ae62 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.260028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53a5e-4d4e-45ba-a694-c56f6642ae62 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.260330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53a5e-4d4e-45ba-a694-c56f6642ae62 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.261972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 238/495] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:40.267445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53a5e-4d4e-45ba-a694-c56f6642ae62 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b3eee81d-39f1-415a-a0ca-84b447683d93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:40.267561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.268650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:40.269783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:40.272860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 258/496] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.274390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.274878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.275358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.293971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:40.295151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:40.349107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.380343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 259/497] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:40.382196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.388227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53a5e-4d4e-45ba-a694-c56f6642ae62 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.421524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.422190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.422473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.422746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.423482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.423789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.425350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.436241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 239/498] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:40.437703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.483570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.487758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217bc9-40a9-476d-b010-0c4b511fdf24 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.521732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.522418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.523262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.523535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.524293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.524598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.525971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.536864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 260/499] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:40.537640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.543996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba098b-51fb-4d58-94b4-5e6707774b86 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.571619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.577137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.577852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.578132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.578406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.579237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.579540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.581019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.618075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 240/500] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:40.618890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.635769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad04c-7131-44ec-8e5e-95d0badb8a5a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.667786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.668594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.668870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.669135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.679254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f483f21e-8e80-4485-89c0-d62b81ea9139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:40.686763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.687678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:40.688499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 261/501] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.689623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307758-b1a9-4b64-b81c-0a7f65c8f0b0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.689623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307758-b1a9-4b64-b81c-0a7f65c8f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.689742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307758-b1a9-4b64-b81c-0a7f65c8f0b0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.690978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 262/502] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:40.691656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11307758-b1a9-4b64-b81c-0a7f65c8f0b0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.711262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.718449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f823dd-25e0-4f51-a061-f27e9ba6256f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.751222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.751934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.752226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.752502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.763762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.765293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:40.783866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.784767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.785610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:40.785610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:40.785610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:40.785610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:40.785610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 241/503] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.785879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.796267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11307758-b1a9-4b64-b81c-0a7f65c8f0b0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.826860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.829726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.830507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.830781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.831049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.839004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.841707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:40.854315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:40.855260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 263/504] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:40.856254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.886404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c610-bc7d-4079-ab0f-c0a8d9455e86 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.918598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.919274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.919549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.919824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.936015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.956691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a97b-d1ad-4219-a86e-87203cde43bc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.985533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.987026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.990716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.991901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.992179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.992479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.993211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.993515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.994881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2331c9-eba8-4069-bdba-a8a3a15b2891 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.002817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 264/505] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:41.003940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.004252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.004535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.019970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:41.021218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:41.030553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.086337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 265/506] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:41.086977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.091667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 242/507] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:41.092692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.161468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.190863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd32f5-6857-410a-a7ab-fb98dcd39f0d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.191485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedac32-cec7-4f73-bffb-b8002e7198b7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.226033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.226701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.227016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.227255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.227804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.227927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:41.228251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.228494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.228777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.229049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.229600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.229870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:41.230223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.231687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.240367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.241006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 266/508] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:41.242394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.254262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 243/509] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:41.254262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.346213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10c6b-82a5-4124-8719-5ddf9f807977 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.349132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82871f45-a7ff-4d88-8e52-817b3e85459f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.374992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.380489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.381269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.381544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.382356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.384002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.384835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.385113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.385382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.392645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.394069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.395139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.396598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:41.411470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:41.412360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:41.413802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:41.413802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:41.413802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.413802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:41.413802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 267/510] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:41.414393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:41.414821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:41.415625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:41.416516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:41.416516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:41.416516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.416516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:41.416516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 244/511] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:41.417066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.466140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.514283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477eac-3d29-4fbe-9b4e-35df423cb47b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.514932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc887d-cce0-4b05-85c6-fdc15f70a99b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.546833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.547645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.547936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.548221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.549376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.550156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.550433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.550705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.557927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.558782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.559374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.560240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:41.575147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:41.576026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:41.576942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 245/512] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:41.577491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:41.577555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:41.578295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:41.579112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:41.579112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:41.579112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:41.579112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:41.579112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 268/513] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:41.580373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.613659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.677968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadf0e-e17b-44c0-9f15-e4d49afb19f9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.679484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de1acf-79c8-48ca-9e09-49386fab5849 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.689053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.711865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.712746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.713773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.714052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.714146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.714720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.715003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.715277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.715986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:41.716326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.717690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.729179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 269/514] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:41.729966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.782379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.783772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.820524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.826582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e7aa5-82c8-4f10-b066-0ba66a5488b9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.859997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:41.860676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:41.860953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:41.861219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:41.861913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:41.862209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:41.863551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:41.875090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 270/515] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:41.875666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.890379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 246/516] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:41.890379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:41.901966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:41.975640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01470a8-059e-4cb1-baca-34409a0f7c95 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:41.987095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07d2e-355b-476d-ac1a-82ea939b5d47 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.008862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.009523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.009806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.010080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.010893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:42.011196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.012677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.019651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.020319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.020596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.020863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.021557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:42.021872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.023274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.034454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 247/517] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:42.035167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.048958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 271/518] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:42.049775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.064881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.104533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.134931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfe55-c7e4-4999-b3c7-5cfa5ff18577 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.147031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95925e-81c3-43ad-96c8-ad555556c45a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.168032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.168844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.169121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.169390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.176696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.178156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.180719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.181498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.181773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.182040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.189109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.190585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:42.196374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:42.197283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:42.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 248/519] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:42.198754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:42.205446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:42.206433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:42.207307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 272/520] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:42.207773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.275999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.300691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a56a63-41b4-4f4e-81bd-48cc30bc068b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.304713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3f3f-3339-4b59-a4c4-928971a1af95 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.329296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.334764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.335605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.335879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.336146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.342125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.342812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.343098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.343363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.344052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.345558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.346614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.348037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:42.365186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:42.366768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 249/521] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:42.367632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.435332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 273/522] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:57:42 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:42.435332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.476927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e84895-7bfe-4315-be8e-59a2d85838b3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.515607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.516296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.516576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.516847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.559926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b851a1-01e2-4e64-81c4-e5df05e8c6fd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.571718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.589109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.591746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.593290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.597397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.598087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.598364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.598632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.599472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:42.599777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.601851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.620318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 274/523] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:42.621206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.716673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 250/524] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:42.717324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.735592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b9b6-9719-4a20-8d1d-5587f99f0224 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.774336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.774988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.775272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.775550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.776378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:42.776685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.778111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.800862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 275/525] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:42.800862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.807747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.826420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103df4e-9792-4829-8e52-f5c7018af2d1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.849889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:42.862362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.864185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.864185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.864185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.864462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:42.864704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:42.866124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:42.878216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 251/526] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:42.879093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:42.909802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59c69-e89f-427a-b360-c86b6538e563 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:42.945346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:42.946214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:42.946658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:42.947070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:42.984932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ad35-7421-4315-bb5e-6ccfa8a878b0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.019691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.020103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.020932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.021210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.021477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.022415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.031757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.033271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.034992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:43.051008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:43.057044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 252/527] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:43.057930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.080828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.142994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 276/528] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:43.142994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.165135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c6e1-ebca-4453-9f50-c6ce15693174 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.203334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.204065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.204435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.204777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.205658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.206026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.207929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.224227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 253/529] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:43.224227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.256480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5ec5-0a98-4268-ab4a-b9da8aa6e6ec None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.296968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.297771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.298046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.298314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.306674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.308393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.312137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:43.326649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:43.329542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 277/530] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:43.330620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.343408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.365663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579269-e7c9-4ed2-8624-db3b5afcee29 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.406315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.407027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.407403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.407772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.408664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.409063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.410683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.425134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 254/531] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:43.426134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.473231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ddde8-253e-44d2-930c-214945a58a94 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.507283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.508379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.508817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.509225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.519967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.521624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:43.539806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:43.540738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:43.541573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:43.541573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:43.541573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:43.541573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:43.541799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563dbb6-ed9f-4ed6-846e-580cce6e3546 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.547996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 278/532] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:43.549088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.560450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.578858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.590842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.603612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 255/533] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:43.612702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.613923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.658795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39e7a6-e7fb-430f-8677-85fa01164a33 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.697087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.698331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.698805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.699311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.706854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.708704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:43.726092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:43.727064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:43.727893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:43.734684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 279/534] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:43.734815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1440905-c77f-42dc-ac0c-3a42e7eac274 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.735876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.777748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.778464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.778750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.779025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.779740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.780046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.781508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.798852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 256/535] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:43.798852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.848865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d68d0-c219-4ad9-b31e-fae6629c96e2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.866957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.881359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:43.885325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.886283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.886728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.887424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.888413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5ab02d4594794adca8c3188d0a9d3d97) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.888861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.890912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.899348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 280/536] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/role_assignments?user.id=5ab02d4594794adca8c3188d0a9d3d97&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:43.900597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.912642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e5fa-3c38-4c13-86ab-7f5232ffd46c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.990149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.990835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.991709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.991995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.992821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:43.993131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.994699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.022795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 257/537] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:44.025871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75572b5-024b-4264-bb25-aa8f097f3fca None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:44.029666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:44.067513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:44.068720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.069297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.070292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.078955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:44.081188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:44.099422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:44.100313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:44.101229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:44.103835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 281/538] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:44.109452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:44.164604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:44.223785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d787d-7b81-415b-9f2b-df15bfb2871c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:44.261049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:44.262197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.262952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.263444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.264447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:44.264945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:44.266551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.280441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 282/539] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:44.288165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:44.296531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71143-ce56-4f4f-aebc-9f638d9193f0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:44.298478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:44.358499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:44.359093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.359378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.359768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.360747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=68f54fc2f2ba403c8fd8c871740d3403) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:44.361061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:44.362539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e342e2f-131b-4b31-8b33-b87057aee2bc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.381007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 258/540] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:44 2022] GET /identity/v3/role_assignments?user.id=68f54fc2f2ba403c8fd8c871740d3403&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:44.432597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204fe47-c181-4614-ac03-829da0fa2656 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:44.440236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:44.493373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:44.494059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.494338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.494610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.495451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=8aa0ee1eea094fcd8bdc87fcc630fb6e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:44.495759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:44.497261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97254a4-6e07-4dae-9ec1-7e18bcc4d134 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.509090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 283/541] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:44 2022] GET /identity/v3/role_assignments?user.id=8aa0ee1eea094fcd8bdc87fcc630fb6e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:44.955176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bde6-7367-482e-a36e-d4e6d36ea0ee None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.956187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bde6-7367-482e-a36e-d4e6d36ea0ee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.956783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bde6-7367-482e-a36e-d4e6d36ea0ee None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.958695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 259/542] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:44.964481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.965283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.965780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.989125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:44.990603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:45.082047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 284/543] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:45.125639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8bde6-7367-482e-a36e-d4e6d36ea0ee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.244304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8bde6-7367-482e-a36e-d4e6d36ea0ee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:45.280777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:45.281961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.282464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.282937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.294871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:45.303044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:45.304358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:45.305163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:45.312296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 260/544] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:45.314087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.426621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:45.433453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7c07c-528d-44bd-931b-c3215ae13e1d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:45.482819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:45.483508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.483791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.484069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.484861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:45.485167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:45.486589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:45.501265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 285/545] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:45.507024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.535346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:45.614648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518814a3-9014-4529-aee7-1305e3582988 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:45.650123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:45.650913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.651198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.651474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.662466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:45.663990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e19af7d8-efbb-4b15-b7c8-1fa03fd96a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:45.682273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:45.683134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:45.683990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:45.683990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:45.683990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:45.683990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:45.687379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 261/546] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:45.689386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.704782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4e4b-585a-4ed2-a495-41987e7fafc9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.705113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4e4b-585a-4ed2-a495-41987e7fafc9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.705331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4e4b-585a-4ed2-a495-41987e7fafc9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.708279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 262/547] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:45.712849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.713136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.713413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.730784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:45.731973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:45.844394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 263/548] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:45.875082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0fb2-3b90-4e2a-8ae5-2b658c1898f6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:45.897661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.901913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:45.955180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:45.955853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.956135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.956433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.957161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:45.957462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:45.958850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:45.989390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 286/549] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:46.005228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.036560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.082261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4243fc-20ec-4aa0-be25-fad5802138ba None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.142782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.143509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.143789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.144062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.165820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:46.177513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:46.179403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:46.180285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:46.182575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 264/550] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:46.190522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.207658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46320-0854-45ee-97cb-7a0d98dabd33 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.284891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.286112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.288307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.288908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.309100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.310556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:46.320521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:46.338276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:46.339329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:46.343041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 287/551] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:46.357236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.372690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f375-0e42-46c2-8530-35c37b4f98d6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.416015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.417012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.417516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.417953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.418901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:46.419361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.420971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:46.439085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 265/552] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:46.444771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.487504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.512626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a85dc-6249-41ed-875f-fe6332d8f620 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.562114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.562787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.563063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.563371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.564479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:46.564782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.566882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4010ecb-df94-4868-98b6-132254a95e81 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:46.568623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f47ba-598e-4d6e-9fc1-904b2154334d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.589385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 288/553] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:46.591258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa72-68de-4e5c-bb03-ed82437e23f5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.591684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa72-68de-4e5c-bb03-ed82437e23f5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.592091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa72-68de-4e5c-bb03-ed82437e23f5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.593647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 289/554] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:46.594327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57aa72-68de-4e5c-bb03-ed82437e23f5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.606416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.618258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.619061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.619327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.619597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.634795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.636286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e4f34386-c1b7-437c-aca7-3c36f2e3d683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:46.657929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:46.658917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:46.659870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:46.659870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:46.659870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:46.659870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:46.664299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 266/555] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:46.665728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.666007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.666336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.688728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:46.690270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:46.716851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57aa72-68de-4e5c-bb03-ed82437e23f5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.755731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.757536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.758057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.758540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.762835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.784286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 267/556] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:46.785503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.853397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.855406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:46.936916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b029b-54e2-415f-b8a8-3b1185bea029 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:46.948376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:46.971864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 290/557] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:57:46.972977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:46.984772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:46.986086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:46.986897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:46.987376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:46.988543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:46.988992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:46.991139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.011175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 268/558] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:47.011175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.018825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.095845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360d0e-a5cf-49ae-81db-ce521caa5da4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.118947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e00e8a-1564-40e8-a4da-fa6cda0aea4e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.131422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.132669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.133123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.133559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.144271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:47.152525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.153984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 291/559] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.154846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.158998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.159788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.160073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.160369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.171185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.172652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5d6cebd0-9a93-4da9-a4b0-7ef06a7b7b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:47.190440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.191337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 269/560] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.192773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfd43-61eb-4375-b36b-f4c0a9e322e0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.193122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfd43-61eb-4375-b36b-f4c0a9e322e0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.193377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfd43-61eb-4375-b36b-f4c0a9e322e0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.196345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 270/561] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:47.196345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dfd43-61eb-4375-b36b-f4c0a9e322e0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.222399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.265468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.271709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9f-574e-44a6-b951-d2c7bad81aeb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.306199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.307226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.308314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.309043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.313591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dfd43-61eb-4375-b36b-f4c0a9e322e0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.317364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.318885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:47.336998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.338045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:47.338983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 292/562] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.339669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.358537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.359240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.359511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.359779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.360591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:47.360834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.362239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658c3c-d8fd-4c2d-8aed-f2fae26435d1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.370736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 271/563] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:47.376214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.376499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.376773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.397831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:47.399090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:47.446022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53736-acda-4e9b-91c0-c9f0b978035a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.466350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 272/564] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:47.467168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.479671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.480746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.481024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.481295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.482348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:47.482657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.484354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.486367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.496572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 293/565] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:47.502286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.514462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.571671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aa3cf-e535-4832-b717-e98dc0abf8b1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.592659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842ab9-fa0a-47f6-8e9f-9ad5f4e55c98 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.604944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.605602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.605883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.606150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.606963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:47.607259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.608724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454247d-2d64-43c5-8403-48589e41e36b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.625874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 273/566] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:47.627224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b123-0f7d-4b21-aa27-c363329004c5 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.627592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b123-0f7d-4b21-aa27-c363329004c5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.627936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b123-0f7d-4b21-aa27-c363329004c5 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.629244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 274/567] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:47.630220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09b123-0f7d-4b21-aa27-c363329004c5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.632992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.633870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.634150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.634420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.644447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.645863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:47.663570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.664565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.665458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:47.665458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:47.665458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.665458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:47.665458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 294/568] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.665737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.705547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.734412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.736436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09b123-0f7d-4b21-aa27-c363329004c5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.768750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f117-9f1d-49c0-ade1-b0b082964a56 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.769673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.770455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.770732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.771008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.781263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:47.788961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.789901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:47.790736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 275/569] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.791468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.806643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.807422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.807698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.807968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.814481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.815920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e292a02d-f849-4be7-926c-31860d8cc318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:47.829434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.830333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:47.831233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 295/570] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.832086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.832330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.832594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.848562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:47.849728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:47.895307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6229-d2eb-47cd-bcd1-9129bbc741c6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:47.915300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 296/571] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:47.916107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.933771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:47.939546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:47.940357 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:47.940639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:47.943120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:47.951774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:47.953241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:47.971108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:47.972169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:47.973157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:47.973157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:47.973157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:47.973157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:47.973157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 276/572] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:47.973469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:47.977782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.018445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f621c-62ce-455e-8bec-6a5de0726cc5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.051460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.052117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.052435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.052709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.053422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.054052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.055401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.066833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 297/573] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.067609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.076640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f379-5fbc-468e-b5e3-2a614dd8534b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.109094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.109745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.110019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.110287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.111003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.111304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.112689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.120269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 277/574] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.121034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.165605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.170379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a2c1a-d794-4c66-8867-d1de8ae1d880 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.187281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.203657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.204356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.204634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.204903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.205672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.205975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.207768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.217608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180f62-658a-4e1a-8ae7-c7a98505a754 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.219181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 298/575] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.219943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.255783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.257070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.257351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.257623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.267538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:48.275792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:48.276730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:48.277574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 278/576] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:48.278271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.320223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860d14-3efa-4844-b555-ca6c1f0fc3c2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.354067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.354727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.355005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.355277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.355993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.356324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.357680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.369047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 299/577] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.369820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.377053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69069ae3-1cce-4698-a07f-e8b184e2ebdb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.379324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.409621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.409777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.410512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.410788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.411056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.417880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.419351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:48.434485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:48.435571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 279/578] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:48.436768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.473460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a12fd-0fe7-44a8-a178-08fea78c735f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.505312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.506138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.506366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.506701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.516715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.518123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.533984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226870-ad35-46c0-8aef-6cd33b6ca921 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:48.535000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:48.535930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:48.536882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:48.536882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:48.536882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:48.536882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:48.540336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 300/579] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:48.541381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.567936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.568603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.568882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.569708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.570513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=3c9fc3f5c10a4b47bca065dcd516fdde) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.570813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.572245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.577487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 280/580] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/role_assignments?user.id=3c9fc3f5c10a4b47bca065dcd516fdde&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.578240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.619485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.644351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.654142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2516-2a84-4579-a7bc-dd66bf4dc20c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.690735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.692230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.692522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.692787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.693546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.693839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.696490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.703737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5667c7-d16b-402d-935c-31aa9e26eb44 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.705143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 301/581] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.705994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.755890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.757926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.758279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.758673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.768125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.769598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:48.784687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:48.785790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:48.786912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:48.790697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 281/582] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:48.791544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.821287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9363-4942-4a54-9fcc-68705aaec453 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.859062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.859727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.860008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.860330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.861203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.861509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.862931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.880104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 302/583] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.880943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.892485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.893933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:48.905603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03addd64-ad69-4ead-98ed-287d05376f74 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.941383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.942059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.942340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.942618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.943334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:48.943639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.945618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.957113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 282/584] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:48.957940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.997042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f35600-8b06-441e-b64f-be464c63ab5c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.031369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.032086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.032399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.032677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.043379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.044852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:49.062687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:49.064021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:49.065206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:49.065206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:49.065206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:49.065206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:49.068501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 303/585] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:49.068651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f29fe-b696-4b52-b564-f3b20af4b6ab None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.069940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.104438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.105091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.105367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.105632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.106394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:49.106692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.108121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.124346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 283/586] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:49.125198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.135000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.136293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.174592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2281c68-0781-44a2-8f08-da211f290371 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.213190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.214140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.214529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.215227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.226318 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18e1d-89a9-4536-b033-3a2e60bf73fb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.226465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.228034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:49.248246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:49.249374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:49.250493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:49.250493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:49.250493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:49.250493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:49.254076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 304/587] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:49.254763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.263406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.264357 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.264645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.264920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.272006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.273508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:49.287977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:49.288954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 284/588] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:49.294718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.363500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.375185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f5d32-16fa-49e2-832f-63b773685c6e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.390205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.399204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402751-0955-4ef0-ad21-4ec23eb2c56a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.412180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.413619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.413898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.414167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.415004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:49.415303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.416701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.430015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 305/589] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:49.430952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.439611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.440522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.440806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.441079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.455398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=fe9f3e7fa6b24e17973f23be244ab083, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.456875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.508016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 285/590] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:49 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:49.509657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.544855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d1d2-0856-4879-9fdf-786ecdeeb7f4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.596219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.597023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.597352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.597673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.598733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:49.599084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.601384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.619878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 306/591] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:49.624751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.654240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a1d0-1918-4852-897a-96a9c6ff6b5f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.674969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.682136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.707926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.708622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.709074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.709351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.710601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:49.711063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.712545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.733393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 286/592] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:49.734167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.771125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942b2f-6106-4de0-a483-819aa0b6bce6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.809105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.809699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.810010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.810281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.818527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.820694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:49.836579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:49.837565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 307/593] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:49.838906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.872467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b19-3df3-4844-9363-317ce94aad7c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:49.909175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:49.910041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:49.910312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:49.910591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:49.917743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:49.919217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:49.934189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:49.935103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:49.936442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:49.940371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 287/594] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:49.941153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:49.972347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.980652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:49.982181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19186e8-2e4f-4e0b-a9f2-266cf2bea729 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.018103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.018898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.019180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.019520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.030933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.032678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:50.051569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:50.052519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 308/595] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:50.058381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.067801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc51b-27ff-40d7-bfc4-22c86aeb6b9d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.102975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.103621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.103905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.104176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.105410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:50.105410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.106746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.130170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 288/596] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 19 11:57:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.131116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.187371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473e2d-eb24-494a-b160-d0d72ec1304d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.222964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.223627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.223908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.224221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.225008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:50.225373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.226991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.244086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 309/597] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.248796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.249094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.254927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711028-4fee-48d0-ae49-6b43c4659f70 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.255913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.301281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.302750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.303211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.304308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.305039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:50.306530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.307942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.329111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 289/598] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.329111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.375376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a5e6-6a3c-4d40-b6bf-a97e189dba59 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.416465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.417530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.417847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.418220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.429827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.431420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.439502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185117d5-82fc-4c1f-928e-ad0552368176 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:50.450510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:50.451610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:50.452769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:50.452769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:50.452769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:50.452769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:50.458945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 310/599] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:50.459959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.482797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.483909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.484843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.485262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5ab02d4594794adca8c3188d0a9d3d97/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.502387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=5ab02d4594794adca8c3188d0a9d3d97, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.503785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.528188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.568377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30d633-f90d-44d8-b0d8-0a9db95d2bed None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.601235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.601943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.602218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.602482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.609134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.610649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.624791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 290/600] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:50 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5ab02d4594794adca8c3188d0a9d3d97/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:50.626347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:50.635991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:50.636999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:50.637899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:50.642706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 311/601] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:50.645490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.646115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.807187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1710b89-ada7-43dc-b573-3070dd197d8b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.847422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.848088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.848397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.848668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.849381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:50.849719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.851392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846ca96-04f5-447d-aa47-9dafcbc7ed57 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.863777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 291/602] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.866349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95ad99-bb49-41ac-8e6d-6e4b86c41bfc None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.866634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95ad99-bb49-41ac-8e6d-6e4b86c41bfc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.866905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95ad99-bb49-41ac-8e6d-6e4b86c41bfc None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.868410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 292/603] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:50.874834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.875186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.875833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.880429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822e95d-e1b1-4344-a95e-6f12c4337765 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.894378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:50.896037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:50.906674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.925890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.927096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.927587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.928061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.930023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:50.930598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.932320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.946543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 312/604] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.947671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.963598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.971880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 293/605] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:50.978417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.073334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9e6d-3ab9-49e8-be2a-2daca47b0784 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.086704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c01a5-84d5-42ce-b288-f15cad047b24 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.108227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.109168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.109555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.110229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/68f54fc2f2ba403c8fd8c871740d3403/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.124856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=68f54fc2f2ba403c8fd8c871740d3403, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.125692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.126588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.126942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.127381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.127799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.136217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.137733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:51.153857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:51.154785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:51.155696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:51.159625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 313/606] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:51.160394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.204333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:51.237229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 294/607] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:50 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/68f54fc2f2ba403c8fd8c871740d3403/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:51.238328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.281485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1b691-8213-430d-8e7c-33fdea1ec5fb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.329045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.330683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.331133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.331598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.346337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:51.347344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:51.357889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:51.359174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:51.360302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:51.362906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 314/608] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:51.369348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.492313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:51.497539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31e46-4141-4529-a1b1-d4b63b3fd647 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.518745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c5294-37ac-45a6-8d75-0f2c58d61b53 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.539357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.541076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.541559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.542323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.543233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:51.543670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.545528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.558328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 315/609] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:51.564567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.580053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.580053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.580053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.580053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.580520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:51.580520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.580520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.592921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 295/610] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:51.598777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.686012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b67ec-fb58-4559-a6bf-7eb2e8b4e810 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.714970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84327ad7-9a92-4c53-97d1-6ebcc094ec76 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.718283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:51.732967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.734247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.734481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.734886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.752225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.752427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.752701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.753122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.753486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/8aa0ee1eea094fcd8bdc87fcc630fb6e/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.754616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.772621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=8aa0ee1eea094fcd8bdc87fcc630fb6e, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.772621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c37592-5598-41f8-adb4-270d73c8fb2d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:51.785107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:51.791960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 316/611] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:51.792909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:51.808465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:51.867962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 296/612] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:51 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/8aa0ee1eea094fcd8bdc87fcc630fb6e/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:51.895010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8736bc-6c24-430d-8c01-91ba47f58a4c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.895321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8736bc-6c24-430d-8c01-91ba47f58a4c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.895662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8736bc-6c24-430d-8c01-91ba47f58a4c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.900415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 297/613] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:51.914620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.914944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.915194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.921130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce639bf-d127-46f2-8eab-0326c37d7905 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:51.941797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:51.942982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:51.979816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:51.980879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:51.981367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:51.981865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:51.982799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:51.983304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:51.984915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.006008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 317/614] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:52.017296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.027697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 298/615] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:57:52.065303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.133631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.169840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba2c-0d39-41b3-9733-1651dcfeccfd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.182348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.198585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b4a0-fae2-4132-895b-4625f8dfd206 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.204166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.204988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.205514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.205514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.214073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.215493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:52.230380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:52.231352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:52.232340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 318/616] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:52.236765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.237560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.238172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.238172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.241586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.249368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:52.257326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:52.259231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:52.260437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 299/617] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:52.268287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.395594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598ddf-0bf6-41b1-8220-430e130b031d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.426301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.432567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.433338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.433615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.433882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.434707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:52.435008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.436775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.455467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 319/618] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:52.460443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.465674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb314-3f90-4234-b964-12239d62f571 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.501570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.502240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.502517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.502862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.503529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:52.503832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.505327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.514361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 300/619] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:52.523849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.538917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.631794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bac9a-5d5c-4996-b2dd-dc245c1575d8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.648167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1843-f3e1-413a-aa7d-45fcc275081e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.666510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.667320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.667602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.667876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.679336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.680819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:52.698712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:52.699662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:52.700650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:52.700650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:52.700650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:52.700650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:52.700650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 301/620] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:52.706496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.752920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.753735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.754016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.754291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.785061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.785279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.786560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.816768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f49d9-1be2-448c-8130-eeb80e349aaf None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:52.834334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:52.835841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:52.836768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:52.836768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:52.836768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:52.836768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:52.836768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 320/621] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:52.843352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.859237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.859907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.860185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.860487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.861317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:52.861625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.863017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.876230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 302/622] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:52.885184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.915294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:52.978305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc82b2b-0d21-4722-9d8c-b620c98a9fb9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.028451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.029363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.029809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.030221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.033412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:53.033916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.035422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.061128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 321/623] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:53.066440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.088920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b1cd-98f9-4008-9204-d9ca5dc000a1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.123829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.157173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.159637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.160063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.160685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.174779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.177672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cf912a0f-f4f9-452b-aa25-40bdaa44d2cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:53.195122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:53.196225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:53.197185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:53.203440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 303/624] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:53.205005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afaac-68b4-4896-9669-06b36985211f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.205432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afaac-68b4-4896-9669-06b36985211f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.205963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afaac-68b4-4896-9669-06b36985211f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.207923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 304/625] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:53.208772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afaac-68b4-4896-9669-06b36985211f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.234883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31af9f-2eac-4200-b70f-b270940a8006 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.236498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.281857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.282712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.283002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.283363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.293450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.294924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-df2b1d81-dc00-43eb-8549-96217682f9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:53.318347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:53.320018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:53.321034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 322/626] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:53.321901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.322713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.323020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.340258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afaac-68b4-4896-9669-06b36985211f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.343071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:53.344332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:53.382802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.384307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.384600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.384882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.385720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:53.386031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.387467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.411032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 305/627] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:53.411958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.433725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 323/628] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:53.434867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.458379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.542292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e295-b4de-4119-a0a6-17152d752b83 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.552885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.564078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9358d13-0336-425e-be68-9c427d7cf1b3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.587421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.588758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.589455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.589899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.591311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:53.592017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.594100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.602338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.602977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.603287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.603986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.614913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 306/629] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:53.616025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.688036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.689580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:53.741535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.751032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767ff4e-1b35-4879-adc6-471618ba60f4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.785221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:53.799431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.800100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 324/630] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:53.800802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.800980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.801461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.801946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.818561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:53.830491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:53.831499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:53.832418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:53.834017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 307/631] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:53.835337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:53.940661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c27160-c56e-4143-ac37-1b81cf3c936b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.942052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60846cc3-bd0a-49df-86f6-1fa7f56964d3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:53.978039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.978777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.979053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.979322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.987474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:53.989194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:53.989810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:53.990398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/3c9fc3f5c10a4b47bca065dcd516fdde/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:53.990935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:53.992652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.008974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=3c9fc3f5c10a4b47bca065dcd516fdde, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.010666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:54.011938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:54.012841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:54.013739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:54.013739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:54.013739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:54.013739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:54.018040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 308/632] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:54.018777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.030650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.091589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 325/633] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:57:53 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/3c9fc3f5c10a4b47bca065dcd516fdde/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:54.092371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.122434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9e31-5989-4010-9167-28bab90b0898 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.163205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.167054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.173393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b0c-8a91-4397-9478-80cc58bca163 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.185800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 309/634] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:54.188411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97fc4a-a649-428e-9594-6814d5b20976 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.188878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97fc4a-a649-428e-9594-6814d5b20976 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.189320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97fc4a-a649-428e-9594-6814d5b20976 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.191959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 310/635] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:54.192993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97fc4a-a649-428e-9594-6814d5b20976 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.241672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d1ce-886e-4fea-a647-6ca04a79350c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.294598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.299101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.299794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.300077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.300380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.301367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:54.301479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.302997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf82c15-fb43-4da4-bee4-6383f6b28e64 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.317501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 326/636] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:54.321855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.321855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.321855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.339275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:54.341305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:54.348413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97fc4a-a649-428e-9594-6814d5b20976 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.391756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.392851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.393569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.393902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.408566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.410122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.413259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 327/637] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:54.417237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:54.434215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:54.435151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:54.436022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:54.436022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:54.436022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:54.436022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:54.438432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 311/638] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:54.443865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.472645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.546278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6d71a-199a-4eab-b2b2-857389420887 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.563093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cbdb-0827-4786-bdf1-0d9c2c2f32a6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.581442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.582236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.582516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.582788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.586698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.590819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.592275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.598148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.599528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.599528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.599528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.600641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:54.600972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.602337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dedc0d-40c0-4a81-add4-49cf12334137 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:54.606696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:54.607561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:54.608522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:54.612640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 328/639] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:54.613791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.619419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 312/640] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:54.620777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429b77-9700-4abc-8bef-de6bd506df7a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.621546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429b77-9700-4abc-8bef-de6bd506df7a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.621817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429b77-9700-4abc-8bef-de6bd506df7a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.627163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 313/641] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:54.627163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429b77-9700-4abc-8bef-de6bd506df7a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.715366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.723851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07468986-2b79-4a6b-829e-6cc99a4a7ecd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.734221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429b77-9700-4abc-8bef-de6bd506df7a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.759309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.760115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.760415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.760683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.769850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.770497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.770784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.771045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.771491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:54.771799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:54.772716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.774887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587aaa0-09bf-4e21-90e7-3e94be91b108 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:54.779791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:54.780982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 329/642] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:54.787319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.796322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 314/643] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:54.796322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b28-979a-46d4-9969-84681da490c9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.796322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b28-979a-46d4-9969-84681da490c9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.796322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586b28-979a-46d4-9969-84681da490c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.814337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-42586b28-979a-46d4-9969-84681da490c9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:54.816442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42586b28-979a-46d4-9969-84681da490c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:54.858246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:54.890754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e149a5-db72-4f93-8f0b-d3fef02906cd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:54.896243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 315/644] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:54.896243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586b28-979a-46d4-9969-84681da490c9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.933797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:54.934590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:54.934875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:54.935146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:54.942713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:54.944718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:54.959118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:54.960509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 330/645] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:54.961515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:54.978420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.013874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586b28-979a-46d4-9969-84681da490c9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.050901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.051563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.051842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.052115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.052876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:55.053224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.055420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.063468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 316/646] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:55.064261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.072403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3d57-6316-4b5f-aebf-6e52930c64fe None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.097214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.109732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.110689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.111167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.111749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.112765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:55.113265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.114847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.121536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 331/647] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:54 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:55.122488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.180935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf9c2-855b-4b3d-9560-ea0a106654ae None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.226515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.227335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.227625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.227896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.246491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:55.254486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:55.255492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:55.256918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:55.260869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 317/648] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:55.261807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.263726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.301783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4cb21-b3e4-47fe-acaf-bcb814525e88 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.353637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.354542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.354976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.355244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.356072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:55.357364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.359260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.382053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 332/649] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:55.383179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.387528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.397833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f1e1-bd5c-4618-a7c1-d79720283d27 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.454414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.455200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.455473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.455740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.469672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.471387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:55.493261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:55.494377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:55.495482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:55.495482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:55.495482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:55.495482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:55.497146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 318/650] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:55.498104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.513683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f78-f3be-417e-bd7a-d498c3ec7800 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.556592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.557696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.558496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.558921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.560081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:55.560559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.562539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.564217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.573976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 333/651] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:55.575228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.619199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210fd0-2058-4fc5-8b74-19c8b0aa4131 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.654764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.655772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.656285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.656759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.673483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.688893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795453-d8a6-418e-ad78-954e9549a9d1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.727840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.728780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.729206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.729560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.729815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.730667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:55.731121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.731430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.732859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.746580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 334/652] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:55.747825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.809981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.838593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 319/653] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:55.839631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.858979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd62cc-4ff8-4c3c-b6e1-76c0294a3a95 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.887685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:55.898013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.899000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.899428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.899844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.910628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.912343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:55.932569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:55.933515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:55.934419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:55.934419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:55.934419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:55.934419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:55.941177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 335/654] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:55.942402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:55.943684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2b086-4d3e-4925-a692-73325aec01be None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:55.979135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:55.980043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.980421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.980764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.988152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:55.989649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:56.004931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:56.005944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:56.006964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 320/655] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:56.007571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.058471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a008ca-80b8-43ef-b046-8cc82547385f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.069309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.097526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.098596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.099128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.099535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.111149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.111548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914a13-5f68-4641-a746-ecb2e2b93b91 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.113126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.119909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:56.135536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:56.136656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:56.137746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:56.137746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:56.137746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:56.137746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:56.139286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 336/656] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:56.140146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.158311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.159194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.159847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.160312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.161595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:56.162047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.164186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.185599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 321/657] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:56.185599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.268136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cee6-30fb-4139-a777-0c1159441386 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.304483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.305306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.305673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.306041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.306968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:56.307371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.308100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaca3b-6929-4e63-9d0b-6347228720d5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.309002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.330593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 337/658] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:56.331579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.355399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.362735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.363711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.364343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.364772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.366011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:56.366696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.368700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.384349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 322/659] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:56.385384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.417347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.454781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0bc68-d835-41db-b85a-76719202b790 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.491527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee84d7-9bed-4abf-8cce-f1c9251dd190 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.491749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.492488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.492769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.493057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.500924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.502347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:56.517528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:56.518490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 338/660] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:56.519450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.533279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.533926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.534205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.534476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.600899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.606493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.608068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.622085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c36ce-fab4-4a2e-88dd-65275dfb5b7d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.635879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.660520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.661332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.661609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.661874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.669224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.670704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e18983a7-d8a9-4e45-9269-fac9d88141ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:56.685280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:56.686363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:56.687448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 339/661] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feddf9-a0ab-4aeb-a396-5068aabeb2b7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feddf9-a0ab-4aeb-a396-5068aabeb2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feddf9-a0ab-4aeb-a396-5068aabeb2b7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 340/662] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:56.693395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feddf9-a0ab-4aeb-a396-5068aabeb2b7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.724865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 323/663] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:56.725796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.797761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feddf9-a0ab-4aeb-a396-5068aabeb2b7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.833100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.833763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.834046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.834847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.835673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:56.835976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.837428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea030-7fd6-4556-bbc3-32a83ec41c72 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.838364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b428e3-682c-46a0-8fbe-24c4fbc3e746 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.846159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.855776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 341/664] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:56.856865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.857150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.857423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.866760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:56.874986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.875640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.875921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.876193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.876988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:56.877297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.877407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:56.878735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.878958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:56.891164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 324/665] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:56.891889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.972869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 342/666] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:56.974339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.994561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451be1-2249-4750-a710-af867ffb8f6e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.031491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.032278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.032556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.032919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.043689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.045177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:57.065292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:57.066255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 325/667] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:57.073039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.082247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c80e9f-7ff4-4d2e-a7de-ac1da3312014 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.108668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.114445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.117322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.117973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.118248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.118517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.184380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e527854-e2b0-42f9-8fee-294229fe8c10 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.200836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.202272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.220541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.221195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.221475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.221745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.222561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5ab02d4594794adca8c3188d0a9d3d97) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:57.222919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.224322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.230517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 326/668] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/role_assignments?user.id=5ab02d4594794adca8c3188d0a9d3d97&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:57.231519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.355180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 343/669] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:57.355180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.372820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262730-c64f-4c7e-9191-69b2f2d947bd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.375620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.385808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.430675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.432622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.432899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.433168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.445075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:57.452775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:57.453722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:57.454572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 327/670] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:57.455273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.492674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c838f2-3841-48a8-8f96-4f95feaf7409 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.529309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.530114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.530349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.530618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.531325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:57.531627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.533010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.544964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 344/671] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:57.545834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.645059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.661173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136fb8-5091-4e11-9272-9b77d7ccead8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.693621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69951e46-1db9-466e-8ddc-f2b9a0694a77 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.697838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.698504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.698782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.699055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.699788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:57.700153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.701573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345aa4e-69ae-4d14-96d2-b7afa1be0de1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.710008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 345/672] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:57.711256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2053-91b8-498f-b96c-9d6f1c0e38ac None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.711538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2053-91b8-498f-b96c-9d6f1c0e38ac None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.711809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2053-91b8-498f-b96c-9d6f1c0e38ac None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.716331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 346/673] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:57.716331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e2053-91b8-498f-b96c-9d6f1c0e38ac None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.736654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.737435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.737717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.737988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.749040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.750413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:57.768173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:57.769128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:57.770089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:57.770089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:57.770089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.770089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:57.773973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 328/674] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:57.774625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.791774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.828972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e2053-91b8-498f-b96c-9d6f1c0e38ac None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.863503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.864323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.864606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.864884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.871723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.873194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.885185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c46d9-0341-45f0-9f36-d83a649d2380 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f2893b84-3aa1-4949-9a37-c58b95c19d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:57.887721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:57.888711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:57.889821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:57.893553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 347/675] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:57.894833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.895117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.895386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.912169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:57.913468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:57.915547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:57.923975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:57.924820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:57.927288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:57.927288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:57.936792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:57.938237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:57.956534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:57.957581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:57.958737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:57.958737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:57.958737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:57.958737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:57.962281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 329/676] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:57.963102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:57.986692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 348/677] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:57.989771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.038665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.073685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9f385-a904-4a46-bec2-3d7700b012ea None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.096637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17723b5c-82c5-4b82-8331-ba97670a02ea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.108385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.109050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.109335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.109604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.110315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.110623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.111986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.123687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 330/678] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.124514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.139327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.140194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.140660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.141122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.141897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.142202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.143633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.150837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.160519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 349/679] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.160519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.236439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5473cb-5509-48aa-9f80-055eb548c1c5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.261209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03b75-469d-42e8-8d6e-ccf49880dfc0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.262223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.271383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.272605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.272905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.273176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.273886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.274191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.275565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.287923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 331/680] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.288804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.300787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.301844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.302124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.302395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.313393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:58.321873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:58.322792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 350/681] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:58.324100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.387980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.401557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c319-f70b-4274-b5e2-528962f3ddc6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.431779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41c871-9652-438c-b801-0f05e734d519 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.437574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.438384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.438658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.438924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.446222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.447660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:57:58.461839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:58.462756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:58.463685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 332/682] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:58.464985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.473412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.474090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.474372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.474691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.479853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=68f54fc2f2ba403c8fd8c871740d3403) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.480176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.481642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.487784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 351/683] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/role_assignments?user.id=68f54fc2f2ba403c8fd8c871740d3403&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.497279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.520647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.585914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff69663-03c7-455e-912a-84e204f96966 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.620741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fb289-e400-4826-96c1-5396000c0342 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.622866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.623753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.624121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.625221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.633450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.635053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.649123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:58.650889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:58.651845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:57:58.652851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:58.656658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 333/684] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:58.657731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.666773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.667818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.668344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.668877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.669767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.670266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.671892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.683348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 352/685] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.684483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.781725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64833-c96a-48ee-8e1e-78f7d8defcba None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.790396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.808761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c619ba-7ecd-4e76-b493-a8de213214c0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.818691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.819359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.819625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.819901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.820714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.821015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.822459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.836250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 334/686] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.840085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.857191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.858020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.858379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.858751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.859675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:58.860076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.861644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.884659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 353/687] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:58.885355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.939735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:58.966831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153d5b-7813-4244-b22a-aff6c8623d4b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.002087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a800e-5aa3-4ea9-9512-02527043515c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.014646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.016386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.016821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.017265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.031141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.033378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.043097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.043962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.044481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.044763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.045705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=8aa0ee1eea094fcd8bdc87fcc630fb6e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:59.046081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.047590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.060236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 354/688] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/role_assignments?user.id=8aa0ee1eea094fcd8bdc87fcc630fb6e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:59.060236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:59.061590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:59.062475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:59.063363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:59.063363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:59.063363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:59.063363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:59.064877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 335/689] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:59.070559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.113072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.255321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c1a06-d80d-41e4-8d34-b52a7cce200b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.267234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.289869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951f82-7354-4c97-a000-14a007c40a12 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.331455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.332340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.332627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.332994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.333486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.334469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.334844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.335209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.336031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:59.336460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.337930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.355943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 336/690] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:59.361668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.431523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.433835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.474737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.503791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6fb2-5bb4-4621-91b7-bc70dd5eb4cb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.544747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.545952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.546457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.547633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.556613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.558343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.560292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 355/691] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:57:59.564069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.572612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a57a120c-340c-4496-a1ce-036384b680be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:57:59.577043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:59.578195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:57:59.579232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:57:59.581341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 337/692] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:57:59.582755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889239a5-abcd-47bf-860b-6d36e9d3d5ca None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.585782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889239a5-abcd-47bf-860b-6d36e9d3d5ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.585782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889239a5-abcd-47bf-860b-6d36e9d3d5ca None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.585782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 338/693] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:59.587027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889239a5-abcd-47bf-860b-6d36e9d3d5ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.685399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d418-af1c-4944-ae3d-a6619f8d9351 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.704178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889239a5-abcd-47bf-860b-6d36e9d3d5ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.720385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.721523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.722011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.722482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.734524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.736304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.741896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.742571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.742846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.743112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.743992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:59.744319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.746061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.755085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3677b44c-9479-4e46-92c3-08e2b1832904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:59.757778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:59.758655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:59.759554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:57:59.759554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:59.759554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:57:59.759554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:57:59.761761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 356/694] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:59.763238 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.763722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.764233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.771327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 339/695] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:59.772337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.783290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:59.784879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:59.845415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:59.860152 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 357/696] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:57:59.861394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.887891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f026-1f4a-43a7-9ae4-d83fa975364a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.928462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.928462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.928462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.928851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.929499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:59.929801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.931166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.944128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 340/697] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:59.944298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.977124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edd790-d32e-4b87-b5d8-3c78d38e5b51 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.002413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.015384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.024172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.024172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.024172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.048555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26d53-48e9-4b30-91a8-d103ee36ff1f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.077493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.085031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.086064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.086509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.086996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.087802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.089754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.092229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.093802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:00.104663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:00.105643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:00.106491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:00.114855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 341/698] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:00.115982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.220359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 358/699] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:58:00.221487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.229973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572d74-19a7-494a-a28e-810e942686d0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.251223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.265717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.266830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.267284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.267723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.274850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.276569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:00.292032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:00.293011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:00.293903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:00.296438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 342/700] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:00.297408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.338398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.361089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96835-43f7-449c-a744-8ae36c55b740 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.408374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.410060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.410550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.411025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.411943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:00.413084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.414955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.425840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 359/701] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:00.425840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.432422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906af6-6847-4b1c-9929-f68474bd6237 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.477200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.478914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.479343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.479773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.494341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.496608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:00.521575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:00.523077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:00.523984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:00.523984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:00.523984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:00.523984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:00.529887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 343/702] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:00.529887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.543770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4992-b006-48d3-aa61-199bcf77f99e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.566055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.585079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.586139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.586657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.587127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.588119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:00.588648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.590284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.604091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 360/703] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:00.605348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.622406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.640368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fd0a-b806-4a71-9cbd-249531c8ce8d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.677731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.679204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.679479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.679744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.680612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:00.680891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.682430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.695301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 344/704] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:00.695301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.763848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc516-b333-4586-ac43-fd825aa0a408 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.852991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.853678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.853967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.854247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.854981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:00.855287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.856719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.871189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.879226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259ebc6-9846-4dea-8805-e541b238d846 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.886499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 361/705] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:00.891931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.917417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.918065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.918342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.918607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.919480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=3c9fc3f5c10a4b47bca065dcd516fdde) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:00.919908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.921425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2106-212c-4384-986f-4aa7f1c4561c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.928234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 345/706] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/role_assignments?user.id=3c9fc3f5c10a4b47bca065dcd516fdde&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:00.985244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780423-dc25-4d90-a30c-1f60bd7edaf0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.985586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780423-dc25-4d90-a30c-1f60bd7edaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.985789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780423-dc25-4d90-a30c-1f60bd7edaf0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.991105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 346/707] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:00.992751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.993008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.993276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.998449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:01.015446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:01.017099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:01.044251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62541cef-4a23-47b4-a1bb-6bf230d46607 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.112029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.113258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.116363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.116893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.129925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.131975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.138489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 347/708] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:01.150539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:01.151537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:01.152536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:01.154986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 362/709] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:01.160733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:01.164446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:01.274626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:01.284365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceea7c-0d02-4573-b3a3-0a1db9059765 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.308710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d9244-c6e5-45f1-8e8b-d41c2bcec701 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.329321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.329994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.330275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.330550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.331402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:01.331714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.333193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.354689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 348/710] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:01.355943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:01.356069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:01.364774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.366212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.366490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.366760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.381123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.383014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:01.405252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:01.406211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:01.407149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:01.407149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:01.407149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:01.407149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:01.409327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 363/711] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:01.417131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:01.482971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423a21-c784-4d71-b4c8-c5d0d1206abc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.519216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.519871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.520144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.520453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.521264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:01.521564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.523056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.529074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 349/712] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:01 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:01.544807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa3e2b-f884-4879-bdfe-3ccea527ab86 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.587501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.588182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.588498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.588771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.589497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:01.589799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.591196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87741e-0e27-41c0-a23e-6c76aa139f53 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.606260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 364/713] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:01.611763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:01.629758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:01.722650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b8a4-76d7-4b29-8388-4f47c75b7f50 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:01.761175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:01.762320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.762817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.763294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.764221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:01.765894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:01.774072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5d9-16ef-4e33-9718-61a145606bb5 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.774423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5d9-16ef-4e33-9718-61a145606bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.774709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5d9-16ef-4e33-9718-61a145606bb5 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.776547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 365/714] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:01.784364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:01.784364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:01.784364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:01.803551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:01.805180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:01.847652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 350/715] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:58:01 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:01.855003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:01.885701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 366/716] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:58:01.909143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:02.016860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:02.057527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf69c37-8ca5-4b7d-8e3c-3eaacb5428f4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:02.111390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:02.112227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:02.112513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:02.112782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] PATH_INFO: `/v3/services/network` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:02.113444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:02.114843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:02.133232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:02.134321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:02.135176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:02.137497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 351/717] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:01 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:02.142774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:02.377873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497d3f-54b9-4a5b-b9fa-a3b297752cc6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:02.416808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:02.417476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:02.417751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:02.418022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:02.418718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] RBAC: Adding query filter params (name=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:02.419015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:02.420378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2a2c4-02e0-459f-a35c-07c73cf99e00 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:02.425086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 367/718] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:02.431523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:02.548874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dfc48-950a-4d31-972f-590800a3cffa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:02.594002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:02.594613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:02.594899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:02.595177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:02.595891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] RBAC: Adding query filter params (type=network) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:02.596210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:02.597625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4c60-133b-4e2c-bc6c-eaf6d4ac3a93 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:02.599070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:02.608166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 352/719] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:03.234294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4bed-b414-4411-bd1f-8e99fcd7936c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.235298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4bed-b414-4411-bd1f-8e99fcd7936c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.235783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4bed-b414-4411-bd1f-8e99fcd7936c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.237636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 368/720] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:03.243513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09e62-32f8-4e92-85e2-08d00ff8c16a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.243806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09e62-32f8-4e92-85e2-08d00ff8c16a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.244084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09e62-32f8-4e92-85e2-08d00ff8c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.261878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-40d09e62-32f8-4e92-85e2-08d00ff8c16a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:03.263075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40d09e62-32f8-4e92-85e2-08d00ff8c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:03.354853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 353/721] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:58:03.397764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c4bed-b414-4411-bd1f-8e99fcd7936c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:03.450926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:03.528601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c4bed-b414-4411-bd1f-8e99fcd7936c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:03.574716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:03.575391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.575669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.575937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.576678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:03.578014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07bafd-3997-477c-886c-b7845bf5d010 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:03.674908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 369/722] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:03 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:04.079393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43200-378a-4e75-b88d-c6b73648ca9c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.079992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43200-378a-4e75-b88d-c6b73648ca9c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.079992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43200-378a-4e75-b88d-c6b73648ca9c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.081595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 354/723] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:04.087856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dc186-11fb-4da3-b320-9e4d7c776660 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.088158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dc186-11fb-4da3-b320-9e4d7c776660 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.088471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dc186-11fb-4da3-b320-9e4d7c776660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.106995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-704dc186-11fb-4da3-b320-9e4d7c776660 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:04.108226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-704dc186-11fb-4da3-b320-9e4d7c776660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:04.201461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 370/724] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:58:04.225788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a43200-378a-4e75-b88d-c6b73648ca9c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:04.284130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734066-ecbc-4aa4-8817-c04254313be9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.284665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734066-ecbc-4aa4-8817-c04254313be9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.284665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734066-ecbc-4aa4-8817-c04254313be9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.286319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 371/725] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:04.296385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.296839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.297742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.318408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:04.320352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:04.354883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:04.397082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a43200-378a-4e75-b88d-c6b73648ca9c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:04.441172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:04.454318 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:04.455107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.455384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.455649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.469263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 372/726] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:58:04.483465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:04.496223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:04.497210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:04.498054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:04.498691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:04.498766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 355/727] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:04.505302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:04.683802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2764c9-49c9-47fe-9958-bd19d53c2a8c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:04.690824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72cfaf-11c7-4f30-80ec-788cc35c08dc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:04.738499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:04.739168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.739450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.739713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.740700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:04.741006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:04.742388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:04.758770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 356/728] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:04.764501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:04.765312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.765593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.765867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.767209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:04.786487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:04.800650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:04.801607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:04.802450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 373/729] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:04.824616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:04.850828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:04.861246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:04.915150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95979b8-a107-4969-aa4c-653c5ca92f4e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:04.951414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:04.952121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.952431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.952704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:04.966921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:04.969022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:04.970627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924806d7-3b81-4dd4-acf7-320cfe7efb35 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8616873a-85f2-41a8-a628-fad81ee680ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:04.991496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:04.992498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:04.993435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:04.993435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:04.993435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:04.993435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:04.993435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 357/730] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:04.998443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9feb-c8f8-4b24-b408-98ebc70c0324 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:04.998443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9feb-c8f8-4b24-b408-98ebc70c0324 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:04.998443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9feb-c8f8-4b24-b408-98ebc70c0324 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.000099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 358/731] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:05.000904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9feb-c8f8-4b24-b408-98ebc70c0324 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.019325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.021045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.022095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.022875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.024130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:05.025140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.026713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87cf13-df74-471b-9439-437ca893db0f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.043732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 374/732] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:05.043732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.043732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.043732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.065862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:05.067868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:05.134512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9feb-c8f8-4b24-b408-98ebc70c0324 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.136909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.160455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 375/733] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:58:05.161411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.174094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.175125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.175657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.176127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.177138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:05.177638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.179626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.181303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.194253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 359/734] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:05.200466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.299317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118871-ed6e-4788-a8bf-e33f7adbdecb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.341918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.343082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.343872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.344303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.353310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9110-5ed2-439d-a5b8-6e97afda77ab None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.361278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.363403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:05.388776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:05.389905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:05.390806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:05.390806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:05.390806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:05.390806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:05.395188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 376/735] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:05.395988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.396115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.397294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.397790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.398272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.407250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.409018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:05.425287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:05.426291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:05.427263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:05.430231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 360/736] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:05.431220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.464541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.469324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.514929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972947-4cb3-4500-b7e3-8ebb6bc4a6c2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.540080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c848-82b2-4b94-bbe0-0e58cfb25a79 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.551732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.552485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.552793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.553226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.565679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:05.573850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:05.574766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:05.575623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 377/737] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:05.576343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.578434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.579088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.579363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.579635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.580683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:05.580984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.582409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d18168-dfd8-49e0-a8d0-60fdedc4272c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 361/738] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dd0c-640c-4fd9-ad23-78ab2aa08917 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dd0c-640c-4fd9-ad23-78ab2aa08917 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dd0c-640c-4fd9-ad23-78ab2aa08917 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 362/739] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:05.598380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624dd0c-640c-4fd9-ad23-78ab2aa08917 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.686531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15312-d49e-419a-9209-0bb4126a723a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.688374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.704825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.707330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624dd0c-640c-4fd9-ad23-78ab2aa08917 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.723244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.723909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.724374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.724714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.725841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:05.726147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.729816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.742633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.743296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.743615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.743892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.744656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:05.744957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.746314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c41743-1433-47f9-906d-3ba95845a2e0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.748680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 378/740] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:05.749491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.763953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 363/741] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:05.763953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.763953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.763953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.778189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:05.779352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:05.851003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 364/742] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:58:05.852159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.869313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cfb3-114d-443d-b6da-3f722f66b609 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:05.906775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:05.907575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:05.907858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:05.908131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:05.916135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:05.918032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:05.932722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:05.933696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 379/743] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:05.934648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:05.954557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.974112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:05.982401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893d82-4307-42df-80ca-76e5f7fb798d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.017954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.019040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.019544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.019818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.042919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7760cc-3ca5-400c-a5ce-bfb883f0559b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.076731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.077516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.077797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.078064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.088600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.090017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.092448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.093897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:06.108127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:06.109131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:06.110036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:06.110036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:06.110036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.110036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:06.113889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 380/744] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:06.114431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.175392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.207791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.213344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 365/745] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:58:06.214370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.225902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c85a1-80ce-48d0-9b88-754cd247586c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.264458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.265251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.265581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.265795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.266524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.267869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.319100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b604-6cfb-4446-abf5-c9624426ae06 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.353559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.354222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.354496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.354765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.355581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:06.355884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.357338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.374610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 366/746] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:06.375339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.377630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 381/747] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:06 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:06.379077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.430090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.505311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20efba5-e747-45ce-8350-0a85bd883844 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.510499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dab3e-c2f0-40b8-9360-95ef04b5d411 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.546050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.547038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.547512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.547950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.548271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.548774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.549053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.549324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.549822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:06.550304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.551902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.562019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.563470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.566128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.566244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 367/748] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:06.567195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a2ed8246-dab7-4781-8455-c9c2a584e8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:06.582139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:06.588819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 382/749] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9f20-06df-4d3e-92e6-88adcf8394d0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9f20-06df-4d3e-92e6-88adcf8394d0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9f20-06df-4d3e-92e6-88adcf8394d0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.589723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 383/750] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:06.590251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9f20-06df-4d3e-92e6-88adcf8394d0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.670409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.679641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5588-c9e6-45e1-a0ca-52685731e6fe None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.692769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9f20-06df-4d3e-92e6-88adcf8394d0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.719748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.720566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.720848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.721126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.731554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.733027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.734201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209318-01a0-40d1-9635-11773854d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.735873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209318-01a0-40d1-9635-11773854d196 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.736386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209318-01a0-40d1-9635-11773854d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.736808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209318-01a0-40d1-9635-11773854d196 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.745777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209318-01a0-40d1-9635-11773854d196 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.747473 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209318-01a0-40d1-9635-11773854d196 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:06.751488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:06.752579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 368/751] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:06.753526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-27209318-01a0-40d1-9635-11773854d196 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:06.767886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:06.769077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:06.770261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:06.773191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 384/752] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:06.775109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.775830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.776292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.797194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:06.798590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:06.852145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.863236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb207-4f0a-4b1f-a29c-67f71ac2b274 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:06.872271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 385/753] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:06.872271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.910983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:06.911662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:06.911990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:06.912825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:06.913539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:06.913841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:06.915268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:06.933340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 369/754] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:06.933340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:06.935785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:06.986163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78e22-2dfa-4ef8-873e-099b9fe67d94 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.024066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.025061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.025343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.025873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.026577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.027104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.029080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.032989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f973d0-9141-4842-9b83-6ad4f14465d0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.047945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 386/755] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.047945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.068254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.069605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.069886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.070160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.070993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.071298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.072759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.089897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 370/756] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.089897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.105532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.149949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.162082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58cbf-dca4-408f-bde2-435890c63eba None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.189494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167db3-64ef-4e8c-a408-b727f41e92a7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.198045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.198953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.199229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.199494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.200276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.201622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:07.216774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:07.217791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:07.218696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 387/757] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:07.219663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.233197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.233995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.234339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.234537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.244542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.246207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:07.260919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:07.261844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:07.262758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 371/758] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:07.263861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.388951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b835c4c-3d75-45d1-8229-e0110fcc63f6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.393484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc007-b69b-46bd-ade0-257e5ff89997 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.399106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.418451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.424616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.425568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.425850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.426120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.431506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.432147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.432461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.434782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.434889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.435281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:07.450129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:07.451185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:07.452299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:07.454084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 388/759] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:07.454996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.514457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.515940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.558636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744fe25-23ff-4c6e-8214-874539325ce7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.598061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.598723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.599000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.599270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.600534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.600836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.602192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.606665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 389/760] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.607439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.631727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 372/761] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:07.632616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.645797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.657418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.715422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090bb9-67e7-48ee-9209-f863173c46b3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.735563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2666-1126-4280-972b-8763436b2d6f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.751086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.751743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.752025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.752344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.753120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.753424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.754835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.771642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 390/762] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.771642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.774791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.775450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.775729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.776001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.776816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.777169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.778712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.798198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 373/763] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.798198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.878400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.887426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:07.895743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49978-c808-4a86-b1f4-ab0adca5def4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.896278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56889e16-d170-48b3-8684-f1c67ddcc005 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:07.931440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.932316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.932448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:07.932605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.933007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.933263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:07.933546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:07.933818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:07.933908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:07.934240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.935695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.941911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 391/764] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:07.945280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:07.946723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:07.947994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:07.965533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:07.966450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:07.967353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:07.967353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:07.967353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:07.967353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:07.971199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 374/765] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:07.971801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.056640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243da5-2c74-4c45-b391-67b9712374fe None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.074365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f10a-aa41-461d-89d3-21850b0ae4bd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.089961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.090619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.090899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.091172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.091991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=3c9fc3f5c10a4b47bca065dcd516fdde) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:08.092328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.093757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.108235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 392/766] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:07 2022] GET /identity/v3/role_assignments?user.id=3c9fc3f5c10a4b47bca065dcd516fdde&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:08.108235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.123068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.124084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.124415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.124693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.126804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=fe9f3e7fa6b24e17973f23be244ab083, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.128545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.131477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:08.141198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:08.225971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777c88-475f-4f10-a64c-312dbb83e0ea None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.235642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 375/767] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:07 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:58:08.237235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.337037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.337730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.338013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.338288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.339089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] RBAC: Adding query filter params (interface=public, service_id=df7d494d6dd54610803371a5e90e271e, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:08.339398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.340801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.355573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 393/768] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/endpoints?service_id=df7d494d6dd54610803371a5e90e271e&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:08.361066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.389010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48480d49-0ed5-445a-add0-01a61d6f905f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.433752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.434972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.435465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.436032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.437192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:08.437714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.439617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.456050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 376/769] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:08.461546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.541725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:08.548237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:08.556819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cb269-835f-4abd-b21c-3181847c32ca None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.594557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.595276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.596339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.596339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.596652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.598017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77242e12-a397-477a-9a6e-1020beaab3d7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.603524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 394/770] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:08.607764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf2aea-7217-41d2-b0a0-578cc344ec5d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.660316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.661561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.662123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.662603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.670886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.672828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.680499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5336b2-cb24-4ecb-9f4e-5287929bdaa1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.680499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5336b2-cb24-4ecb-9f4e-5287929bdaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.680499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5336b2-cb24-4ecb-9f4e-5287929bdaa1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.685240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 395/771] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:08.687043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.687399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.687741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:08.701439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:08.702428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:08.703332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:08.705625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 377/772] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:08.709604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:08.710985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:08.711590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.828422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 396/773] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:08.844959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.861844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b2b3-0455-4b4c-bd9b-d3a0650f19e4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.880835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:08.910668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:08.911331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:08.911606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:08.911897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:08.912777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:08.913120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:08.914561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:08.929355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 378/774] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:08.935962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:08.961856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684b88-8a78-4673-8e2b-efa36871d61c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:08.965051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:09.020678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.022083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.022361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.022627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.023380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.024927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.038701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a4fc-1bb3-4cdf-a9b2-3a3cf36fca03 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:09.043061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:09.044041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:09.044922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:09.049640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 397/775] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:09.054917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:09.074808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.075468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.075791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.076069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.076919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5a997ab3c1b44133ba74d2f514cf2979) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:09.077228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.078788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.085605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 379/776] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:08 2022] GET /identity/v3/role_assignments?user.id=5a997ab3c1b44133ba74d2f514cf2979&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:09.224992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8dc9-943f-434e-828f-3ce599a3afd2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:09.261536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.262665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.263145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.263614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.264550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] RBAC: Adding query filter params (name=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:09.265067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.266667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.272916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 398/777] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:09.280231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:09.349217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:09.413093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a07fea-a688-4936-8379-a5761b68e675 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:09.448705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.449369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.449649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.449917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.450611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] RBAC: Adding query filter params (type=network) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:09.450912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.452294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.457521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 380/778] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:09.462951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:09.474941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:09.584490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85592-aaf8-48b1-a11e-9cf379bae428 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:09.628221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.628810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.629090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.629360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.630142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] RBAC: Adding query filter params (interface=public, service_id=a9de5fa8dbfb43379d56e0d465137ece, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:09.630449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.632382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870f26-728b-43d0-8512-af246fe381de None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.640433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 399/779] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:09 2022] GET /identity/v3/endpoints?service_id=a9de5fa8dbfb43379d56e0d465137ece&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:09.646028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:09.812456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099595-5f81-4312-8750-e8c130d39a15 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:09.814001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:09.865897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:09.866615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:09.866899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:09.867175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:09.867863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:09.869276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1446ef-3797-4555-9192-6c735ed1d6d3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:09.881597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 381/780] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:09 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:11.004631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092c6c-95d6-4a67-95a4-229f20d9b392 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.005184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092c6c-95d6-4a67-95a4-229f20d9b392 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.005184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092c6c-95d6-4a67-95a4-229f20d9b392 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.006680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 400/781] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:11.006785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c9ec-968a-44c7-a370-a8fda01cea73 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.007132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c9ec-968a-44c7-a370-a8fda01cea73 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.007304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c9ec-968a-44c7-a370-a8fda01cea73 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.010411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 382/782] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:11.015656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.015940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.016230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.016440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.016730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.017009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.034796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:11.036329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:11.038070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:11.039357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:11.113538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 383/783] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:11.139708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.174771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 401/784] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:11.222010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.224123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.242895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.249137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3372e-7df8-4682-a6f7-c3888eb58fe9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.286430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.287684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.287961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.288267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.300389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:11.311089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:11.317832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 384/785] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:11.318785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.443115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a298f-483c-44a6-a570-fc66838b7370 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.474356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f070981-eab1-4640-a492-bd618656c3a4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.490107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.490785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.491068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.491343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.492087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:11.492412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:11.493792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:11.512804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 385/786] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:11.531253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.532052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.532366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.533524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.540432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.555570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.565293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:11.573747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:11.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:11.575803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 402/787] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:11.581035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.645743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.649654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b26c3-b3a5-4250-8ffb-a7aadd328a12 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.686790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.687573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.687856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.688125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.688708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06452-9583-49c5-914f-70ae33c78930 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.699837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:11.701306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d819d6d1-27a5-40a0-b6bf-202b9e0a9e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:11.719275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:11.720231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:11.721157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:11.721157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:11.721157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:11.721157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:11.721157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 386/788] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:11.722144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04672a-96d1-4de1-b8b3-eccf2ba7da9f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.722144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04672a-96d1-4de1-b8b3-eccf2ba7da9f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.722307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04672a-96d1-4de1-b8b3-eccf2ba7da9f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.723673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 387/789] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:11.724767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f110a-b4f0-43c4-925a-c238239fe331 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.725050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f110a-b4f0-43c4-925a-c238239fe331 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.725297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f110a-b4f0-43c4-925a-c238239fe331 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.726483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 388/790] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:11.727161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f110a-b4f0-43c4-925a-c238239fe331 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.733537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.734614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.735057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.736416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.737323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:11.737777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:11.739309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b981f5-1b04-4c97-8b0e-33b82261bdd5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:11.754514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 403/791] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:11.754514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d331b-bd85-4a7e-bd41-2785b0d3c359 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.754514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d331b-bd85-4a7e-bd41-2785b0d3c359 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.754514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d331b-bd85-4a7e-bd41-2785b0d3c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.769263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d93d331b-bd85-4a7e-bd41-2785b0d3c359 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:11.770432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d93d331b-bd85-4a7e-bd41-2785b0d3c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:11.812585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.848224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 404/792] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:11.848224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.848224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.848224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.855102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f110a-b4f0-43c4-925a-c238239fe331 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:11.860088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:11.861344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:11.892837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:11.893498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:11.893872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:11.894200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:11.894843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:11.895246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:11.896830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:11.912846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 389/793] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:11.912846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:11.916401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:11.944240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 405/794] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:11.944240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.028303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849c9d7-fd38-40e2-8da8-fd705a7a5ea8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.038272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6edfc-dc51-40fc-8cf8-0e87185738de None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.062238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.076271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.076271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.076271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.076271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.076699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.076699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.076699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.076699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.081238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.082874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.085953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:12.093872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.094829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:12.095689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:12.100473 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 406/795] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:12.100579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.101399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.102686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:12.102686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:12.102686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:12.102686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:12.103307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.103455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 390/796] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.103455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.154466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.208299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e75e-85c4-45e7-a57d-4bbc934c9824 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.212758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ec2a-0f8f-4465-9443-d68fb4059055 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.245250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.246072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.246349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.246621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.247943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.248051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.248127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.248376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.248649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.248755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.257062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.258471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.261872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.262823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:58:12.263660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:12.268325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 391/797] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.268800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:12.273538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.280616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 407/798] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.281852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.331017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.386646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8fb3-632c-4994-85ab-d337d39d45a1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.389880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f3742-7e21-40af-a564-69519b0ae3c0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.393392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.420527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.421194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.421475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.421744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.422481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:12.422783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.424151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.428953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.429866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.430142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.430408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.431123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:12.431422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.432786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.434967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 392/799] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:12.435828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.450362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 408/800] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:12.451376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.545823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0cf85-6df5-4be6-95b3-473208530aac None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.555979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.557079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c38f-587c-4d90-aa58-abf53489e3d6 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.582065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.582657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.582958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.583209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.583961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:12.584299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.585730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.590961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 393/801] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:12.591585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.599193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.599936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.600242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.600523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.601377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:12.601681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.603164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.622677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 409/802] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:12.623939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.651175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.706643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd85f-2fd6-4f41-bcf2-083396cf9ae2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.728992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a0f24-adde-4e7e-9ccd-284bab70c16f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.746936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.747720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.747995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.748298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.759295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.760804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.770851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.772552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.772912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.773201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:12.778737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.779797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 394/803] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.780985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.785621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.787600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:12.802404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:12.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 410/804] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:12.805431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.809059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.882218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93f46-314f-4467-8682-5857e9e0541d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.887119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:12.904366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b81a1-b0fc-4d52-91ee-94cbc4c3f499 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:12.916030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.916704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.916978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.917245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.917969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:12.918264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:12.919613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583cbe-b18b-4d5d-a95f-26201dd37bc5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:12.924242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 395/805] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:12.925486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a73dd-2e16-4c34-a859-e68fe1f74aaa None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.925771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a73dd-2e16-4c34-a859-e68fe1f74aaa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.926058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a73dd-2e16-4c34-a859-e68fe1f74aaa None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:12.927240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 396/806] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:12.927949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a73dd-2e16-4c34-a859-e68fe1f74aaa None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:12.942796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:12.943951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:12.944256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:12.944531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.010958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.012417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.015434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.028750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a73dd-2e16-4c34-a859-e68fe1f74aaa None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.061551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.062230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.062507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.062782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.063483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:13.063780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.065221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.077517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 397/807] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:13.078448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.091506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.109360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 411/808] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:13.110139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.175794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3c47-fe38-4767-aa9c-d42fe356fea5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.207596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b24c6-bcf2-4981-8a69-e096c6e1230f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.209441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.210094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.210370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.210634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.211453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:13.211749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.213209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9920d8-26f3-4f93-8b5d-63424d8d079b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.230981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 398/809] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:13.232362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.232645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.232917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.243936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.246541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.247219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.248438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.248438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.248588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.249657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:13.249909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.250818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:13.314725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 399/810] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:13.315529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.393236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 412/811] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:13.394070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.421384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140abc0-16bf-4173-a2ac-b6795f8319de None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.459765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.466596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.471412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.472363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.479362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.479362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.481792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.483421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:13.499817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:13.501234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 400/812] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:13.502567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.532918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05d30a-c79d-49fe-92d0-e2ade23ab692 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.572480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.573993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.574284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.574555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.587732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.590025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:13.611228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:13.612156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 413/813] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:13.613109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.626514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a9065-6e8f-40a7-b670-37df109b53f0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.662578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.663370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.663653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.663925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.674324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.675771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:13.694161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:13.695084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:13.695965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:13.695965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:13.695965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:13.695965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:13.695965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 401/814] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:13.696693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.722068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.731875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fcb77-4336-45a0-a5ef-d0f1e545195f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.745413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.770674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.771528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.771810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.772082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] PATH_INFO: `/v3/services/network` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.772760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.774121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:13.786234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:13.787817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:13.788687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 414/815] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:13.789484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.802000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49391bba-c6f5-4ede-a263-82db71b01bf9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.836933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.837607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.837886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.838158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.838981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:13.839292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.840764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.862708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 402/816] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:13.862708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.895987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbb3f9-b62c-407a-a04c-1a1835434ede None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.934164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:13.935110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:13.935599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:13.936050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:13.936987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:13.937297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:13.938654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:13.951290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 415/817] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:13.952130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:13.971954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd21b3-9689-4418-8864-494a56abd26b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:13.972423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.975776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.008372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.009085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.009364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.009637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.010354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.010656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.012027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.024737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 403/818] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.025802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.066409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4322-d305-4354-a700-c0b255e63f1b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.107057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.107707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.107989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.108298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.108995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.109299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.110655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.115832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 416/819] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.117027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.131044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5559884-ee8e-4de8-b552-b6516b59829d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.167796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.168979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.169408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.169823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.182459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.184355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.199751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:14.203161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:14.204235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:14.205266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:14.205266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:14.205266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:14.205266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:14.205684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 404/820] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:14.206470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.224848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.227354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ef03-24ef-4048-8ae5-62cc44c5b3e0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.261516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.262309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.262584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.262849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.269899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.271396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:14.285089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:14.286014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:14.287436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 417/821] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:14.287942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.319485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474f29d-9216-4547-9264-412fb73f9d43 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.361079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.362081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.362501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.362937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.369901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.371487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:14.388219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:14.389149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.390042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:14.392394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 405/822] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:14.393658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.402901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f5a13-4107-47a4-bba5-a881b7083d83 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.447625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.448746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.449216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.449679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.450866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] RBAC: Adding query filter params (type=network) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.451337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.452898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.457875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 418/823] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.458560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.461382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.485940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.504544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383be9-f789-42a2-bca5-98ac36a4c550 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.541430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.542500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.542948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.543379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.544145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.544509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.545883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.563158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 406/824] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.563158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.569884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fca5a-2a42-45f2-b1f1-36cbc0d7121d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.602947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.603605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.603881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.604154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.605001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.605305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.606715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.619383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 419/825] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.621439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.671340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc30cd-34e5-4c7c-901c-f65b01edff11 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.683761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.712301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.712962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.713269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.713518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.714292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:14.714602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.716041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.717866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:14.723869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24dcc-454f-47ac-ac48-c661b3217add None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.729037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 407/826] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:14.730111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.764297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.764880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.765159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.765439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.766160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.767511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.833449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa242a2-bf56-4f28-a559-e1386e526733 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:14.865525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:14.866296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:14.866569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:14.866832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:14.873202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:14.874622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:14.884595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 420/827] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:14.885514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:14.897428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:14.904765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 408/828] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:14.905919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:14.976423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:15.024077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900626-e39a-45a9-82c1-bf4aff8184a9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:15.029547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b888c-ca88-41e7-b55c-32a1025072e9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:15.041214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:15.064750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:15.065742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.066090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.066464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.067392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:15.067811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:15.069965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:15.071956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:15.073935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.074400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.074854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/3c9fc3f5c10a4b47bca065dcd516fdde/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.077287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=3c9fc3f5c10a4b47bca065dcd516fdde, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:15.078968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:15.079434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 421/829] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:14 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:15.080398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:15.186120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 409/830] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:14 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/3c9fc3f5c10a4b47bca065dcd516fdde/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:58:15.217341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93985-dccc-4b84-916d-e72d0ee3d4c9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:15.261294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:15.261989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.262272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.262544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.263358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:15.263732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:15.265270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ceb9-9271-4d40-94d3-025e25191fb3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:15.281197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 422/831] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:15.287472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:15.411204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64e10e-7084-4b89-a837-f69802ea728f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:15.427024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:15.449765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:15.450660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.450939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.451208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5a997ab3c1b44133ba74d2f514cf2979/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.468662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=5a997ab3c1b44133ba74d2f514cf2979, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:15.470165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672c00-3d2c-494c-9ff7-3ebf3f1938c4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:15.549435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 410/832] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:15 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5a997ab3c1b44133ba74d2f514cf2979/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:58:15.750168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb785-520c-44e7-99d9-3b3403b2b5d1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.750555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb785-520c-44e7-99d9-3b3403b2b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.750747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb785-520c-44e7-99d9-3b3403b2b5d1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.752292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 423/833] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:15.758360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:15.758915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:15.759395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:15.777203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:15.778723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:15.854552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 411/834] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:15.878039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeb785-520c-44e7-99d9-3b3403b2b5d1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:15.929815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:15.993012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeb785-520c-44e7-99d9-3b3403b2b5d1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:16.028637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:16.029838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:16.030119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:16.030391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:16.031047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:16.032444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:16.045015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:16.046025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:16.047098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 424/835] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:16.054697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:16.158450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:16.168117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8bb1d-8dd7-4968-a967-7de6e199bb5e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:16.207469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b3abd-8421-4385-8386-583003344457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:16.208417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3abd-8421-4385-8386-583003344457 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:16.208554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3abd-8421-4385-8386-583003344457 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:16.208923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3abd-8421-4385-8386-583003344457 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:16.209513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3abd-8421-4385-8386-583003344457 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:16.212228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3abd-8421-4385-8386-583003344457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:16.212228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3abd-8421-4385-8386-583003344457 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:16.216268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 412/836] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:16.222991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:16.330516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcfb18-12c0-4599-9eb0-6fe29db85423 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:16.332130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:16.367402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:16.368092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:16.368406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:16.368689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:16.369486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:16.369795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:16.371232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a903e6-135a-4a9d-8ef4-41b6f46ea448 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:16.376896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 425/837] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:17.479924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b050b-47c4-40bc-9519-53fb3fdeb1fc None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.480531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b050b-47c4-40bc-9519-53fb3fdeb1fc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.480531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b050b-47c4-40bc-9519-53fb3fdeb1fc None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.482134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 413/838] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:17.488122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933f581-49bd-460f-a9fd-0bc66e222440 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.488692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933f581-49bd-460f-a9fd-0bc66e222440 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.488780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933f581-49bd-460f-a9fd-0bc66e222440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.507016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9933f581-49bd-460f-a9fd-0bc66e222440 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:17.508220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9933f581-49bd-460f-a9fd-0bc66e222440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:17.578258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 426/839] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:17.603396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b050b-47c4-40bc-9519-53fb3fdeb1fc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:17.624993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c646a5-1d8e-4a50-afbc-e0d3b9236cf2 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.625623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c646a5-1d8e-4a50-afbc-e0d3b9236cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.626123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c646a5-1d8e-4a50-afbc-e0d3b9236cf2 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.627988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 427/840] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:17.633419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.633703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.633981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.653046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:17.654651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:17.728758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b050b-47c4-40bc-9519-53fb3fdeb1fc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:17.745210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 428/841] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:17.767648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:17.767869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:17.768878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.769300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.769822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.770628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:17.772854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:17.786333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:17.787600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:17.788745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:17.791444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 414/842] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 19 11:58:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:17.797340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:17.800495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:17.824612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:17.892978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49147c18-289f-45cb-9d79-1e2686297f2c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:17.911780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5f372-6427-43cf-b4fb-c1f388c2beed None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:17.930804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:17.931587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.931864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.932130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.942713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:17.948066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:17.948746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.949029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.949300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.949990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:17.950297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-ddb3f369-8801-43be-aaa9-9f31294a739e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:17.950485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:17.951353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:17.952794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:17.953497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:17.956461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 429/843] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:17.956932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 415/844] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:17.957564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:17.957917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20bb68-c61a-41fb-af8b-7a758307f57d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.958166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20bb68-c61a-41fb-af8b-7a758307f57d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.958441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20bb68-c61a-41fb-af8b-7a758307f57d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.964679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 430/845] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:17.965949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:17.966090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:17.966300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:17.989411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:17.991193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:18.057781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.066684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 431/846] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:18.066684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.083683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cff8e-875a-43e0-ac19-29db7c74e76d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.091034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.122056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.122874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.123197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.123476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.124226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:18.124536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.125906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.135156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 416/847] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:18.138037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.175404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553eb8-8b39-46c8-a032-234a2f8c408a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.211628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.213077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.213367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.213640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.214340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:18.214641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.215995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.221688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 432/848] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:18.222461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.257594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678238-3644-4f97-83b4-f74464504842 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.297335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.298634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.299114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.299466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.312139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:18.321184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:18.322195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:18.323564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 417/849] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:18.328869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.342771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.343804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.373131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6506b4-fbee-4ed6-9cff-90860f54f37a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.426882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.428709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.429759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.430263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.445946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.448245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.451487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf4eb-6ee1-477e-a58b-ff3a2d86af94 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:18.466768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:18.467814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:18.468784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:18.468784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:18.468784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:18.468784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:18.468784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 433/850] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:18.473804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.495289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.496743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.497246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.497766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.498800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:18.499349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.501042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.512811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 418/851] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:18.518099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.594969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.609426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daff5-c8d1-4595-aa20-bc3de86d58ee None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.633178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dcaed-4b6a-4461-97c0-6d4149eff158 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.641261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.646962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.653168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a913-ebe2-4247-8d02-20fb37ed9e0e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.663308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 434/852] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:18.664726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b80e-150f-4fac-a73f-b9e6d78cf3b1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.665012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b80e-150f-4fac-a73f-b9e6d78cf3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.665287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b80e-150f-4fac-a73f-b9e6d78cf3b1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.668236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 435/853] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:18.668377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b80e-150f-4fac-a73f-b9e6d78cf3b1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.677095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.677823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.678132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.678408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.690450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.691969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a0bbdec8-b04a-49d3-9ec7-d6d037143bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:18.709508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:18.710433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:18.711423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:18.711423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:18.711423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:18.711423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:18.715338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 419/854] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:18.716431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.716724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.717005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.733581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:18.734751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:18.781763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b80e-150f-4fac-a73f-b9e6d78cf3b1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.804736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 420/855] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:18.805650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.822095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.822892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.823174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.823500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.831623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.833110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:18.847610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:18.848638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 436/856] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:18.849757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.876028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.908406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:18.924972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678be2f-ebfa-4f3f-a08b-9aafe4dcffc7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.957574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519d739-7e32-42ff-8718-b84d5d290ff1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:18.962317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.962977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.963252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:18.963518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:18.964242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:18.964542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:18.965916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:18.981643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 421/857] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:18.981643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:18.998698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:18.999531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:18.999818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.000408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.001183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.002557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.080235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 437/858] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:18 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:19.080235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.085157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697323fb-1d58-49a0-8052-49f078d21a99 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.103509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.138078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.139154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.139429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.139696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.141099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:19.141545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.143272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.171905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 422/859] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 19 11:58:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:19.173525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.223506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd626fd-c742-430f-bdf0-fd046d2562c4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.240918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.264359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.265967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.266249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.266536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.277182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.278787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:19.297325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:19.298384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:19.299346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:19.304459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 438/860] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:19.304607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3750b3-fb75-4f94-9f65-c5c143b348ef None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.308279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.355784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.356641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.357040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.357924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.406741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.433441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c62d-e10b-446d-b2b9-dee4bea13319 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.444955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.446699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.484530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.485272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.485649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.486016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.486974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:19.487372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.489486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.514655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 439/861] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:19.520015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.555325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.573201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 423/862] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:19.578042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.638685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7e05-362b-4ed6-8594-2b24001cf419 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.661589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.679531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.680181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.680493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.680762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.707352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51454-f5cf-4d4d-8043-af8f8862fe7c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.751704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.753015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.753256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.753706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.754161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.754717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.766888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.769109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.785185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:19.792426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:19.797099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:19.798065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:19.798065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:19.798065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:19.798065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:19.798065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 424/863] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:19.801900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.874705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 440/864] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:19.881983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.924941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197601-9eae-486e-b65a-55887887cb8f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:19.965588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:19.966257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:19.966541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:19.966816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:19.967977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:19.968317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:19.968857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:19.972939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:19.988405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 425/865] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:19.994311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:19.995724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360bd5-a898-43af-836f-309ecdb44829 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.031949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.038716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.039507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.039788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.040065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.053310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.055255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:20.079171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:20.080100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:20.081021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:20.081021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:20.081021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:20.081021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:20.088566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 441/866] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:20.090251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.128322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12033e2-efee-4c05-85e6-0b893efa4463 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.175380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.176481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.176767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.177043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.187173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.189032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.196314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1cdb-c078-487b-b83a-8dc149816107 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:20.207451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:20.208675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:20.209555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:20.216220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 426/867] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:20.217296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.239751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.240503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.240810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.241600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.242396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:20.242705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.244720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.266549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 442/868] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:20.266743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.268511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.329911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110e00-7305-49d9-a712-e0411db3cb88 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.330561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.370154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.371232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.371732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.372227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.373444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:20.373970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.375675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.394807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 427/869] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:20.396232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.409954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52d3b2-b8bb-4a34-bd75-c1abe0133537 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.455247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.456441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.456919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.457384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.465173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.466809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:20.481451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:20.482366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:20.483249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:20.490211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 443/870] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:20.491284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.525920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.531322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355e2b-d5dc-423f-91a1-f7a7f868947b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.571828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.572512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.572847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.573126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.573973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=3c9fc3f5c10a4b47bca065dcd516fdde) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:20.574509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.575710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaba46-722b-45b0-b823-f08db5f23897 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.588304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 428/871] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/role_assignments?user.id=3c9fc3f5c10a4b47bca065dcd516fdde&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:20.588304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5471f-eaa6-4445-ac58-26c9d577dec0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.588304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5471f-eaa6-4445-ac58-26c9d577dec0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.588304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5471f-eaa6-4445-ac58-26c9d577dec0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.588304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 429/872] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:20.591879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.592167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.592472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.603784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea3ae3-a603-4eb8-9ad8-120e9b80fb84 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.605700 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.613091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:20.615509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:20.643109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.643770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.644215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.644522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.645308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:20.645612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.647608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.660487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 444/873] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:20.669315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.708356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 430/874] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:20.736353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:20.808769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db753d-6821-4107-aba1-d2bdfd7d7ca5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.849628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.850331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.850613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.850883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.851702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5a997ab3c1b44133ba74d2f514cf2979) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:20.852014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.853792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d86a89-fa77-4bf6-ada2-a84301e6bb0e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:20.858328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:20.860720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 445/875] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:20 2022] GET /identity/v3/role_assignments?user.id=5a997ab3c1b44133ba74d2f514cf2979&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:20.868637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f366e28-42a7-40a7-8530-ba707f035124 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:20.910447 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:20.911376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:20.912393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:20.912811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:20.913711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:20.915274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a71c-780c-421e-a164-1603af2905c3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:21.016409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 431/876] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:20 2022] POST /identity/v3/services => generated 269 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:21.409080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8aff-3e98-4d04-a746-d2f1467171ca None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:21.409434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8aff-3e98-4d04-a746-d2f1467171ca None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:21.409642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8aff-3e98-4d04-a746-d2f1467171ca None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:21.411273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 446/877] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:21.416783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:21.417075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:21.417351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:21.435231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:21.436464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:21.512507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 432/878] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:21.534856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe8aff-3e98-4d04-a746-d2f1467171ca None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:21.564305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:21.639126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe8aff-3e98-4d04-a746-d2f1467171ca None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:21.672863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:21.673654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:21.673931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:21.674198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:21.674844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:21.676213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:21.688730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:21.689774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:21.690622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 447/879] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:21.696154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:21.778803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:21.800603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9a5d-2e50-4bc7-a920-d3f58b8970d9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:21.842082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:21.842803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:21.843088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:21.843362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:21.844064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:21.844398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:21.845769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:21.851246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 433/880] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:21.856774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:21.952643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:21.960356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc710-bb9c-4351-a580-9e9b7421a857 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:21.994458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:21.995173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:21.995457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:21.995732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:21.996466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:21.996769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:21.998127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:22.003315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 448/881] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:22.009707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:22.116796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1e5c-e519-494f-861c-7e0320395faa None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:22.151999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:22.153031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:22.153509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:22.153986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:22.154948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] RBAC: Adding query filter params (interface=public, service_id=30bd068978f5474fa6ec10b2da03c74c, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:22.155460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:22.157059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dae49b-f816-4c81-b5bc-0787587a91e1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:22.164946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 434/882] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:22 2022] GET /identity/v3/endpoints?service_id=30bd068978f5474fa6ec10b2da03c74c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:22.175780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:22.281068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f4b3c-db26-4d61-be25-94c3d6f80852 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:22.316389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:22.317350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:22.317838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:22.318315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:22.325150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:22.326846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866a6a-0617-451c-9ea2-ba10f4a401c5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:22.333582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 449/883] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:22 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:58:22.942069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f45a-99d6-41b8-aa62-2885c0428ee2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:22.942593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f45a-99d6-41b8-aa62-2885c0428ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:22.942593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f45a-99d6-41b8-aa62-2885c0428ee2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:22.944323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 435/884] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:22.949689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365314a3-6789-4710-b546-7f229336c5ac None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:22.950094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365314a3-6789-4710-b546-7f229336c5ac None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:22.950266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365314a3-6789-4710-b546-7f229336c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:22.967479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-365314a3-6789-4710-b546-7f229336c5ac None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:22.968678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-365314a3-6789-4710-b546-7f229336c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:22.982250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.042288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 450/885] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:23.064675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f45a-99d6-41b8-aa62-2885c0428ee2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.074283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.171758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f45a-99d6-41b8-aa62-2885c0428ee2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.202351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3a2-c085-4953-8189-0db290c33f36 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.202640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3a2-c085-4953-8189-0db290c33f36 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.202815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3a2-c085-4953-8189-0db290c33f36 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.204826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 451/886] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:23.213650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.214080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.214457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.215521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.216604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.217035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.217502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.218367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.219988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:23.234052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:23.235369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:23.236435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:23.238048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:23.239283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 436/887] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:23.239465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:23.246155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.326503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.344488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 452/888] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:23.367847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.369205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ae7a-6f8c-46d1-b9ad-6d78159df0a5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.406130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.407069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.407346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.407611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.408342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:23.408642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.410001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ddfcd-7d13-4099-bad5-aeff7c198de0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.416237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 437/889] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:23.416876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e15b3-bd38-491d-b363-950431b5c105 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.417155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e15b3-bd38-491d-b363-950431b5c105 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.417429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e15b3-bd38-491d-b363-950431b5c105 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.418938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 438/890] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:23.423098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e15b3-bd38-491d-b363-950431b5c105 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.460671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.484502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c29b2b-4273-4805-b71e-76566c9640a8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.521758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.522720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.523137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.523385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.530424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e15b3-bd38-491d-b363-950431b5c105 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.534203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-5f4445b9-a2e9-4c2b-a9aa-262ced202a35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:23.542868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:23.543836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:23.544740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 453/891] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:23.545448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.545516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.546147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.562400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:23.563580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:23.574271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.575270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.575744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.576231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.577245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:23.577866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.579298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.580718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.596231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 439/892] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:23.596231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.663207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 454/893] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:23.686201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.701708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6eb9-6259-41d1-859e-69ae0f9c6696 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.742078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.742819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.743105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.743378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.744183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:23.745101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.746110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.761886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 440/894] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:23.763588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.764160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.808561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f00002-e276-4bdd-b8ac-51fdf59c3f82 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.845338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:23.845900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.846742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.847002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.847264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.847910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.849863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:23.865501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:23.866469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:23.867300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:23.871615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 455/895] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:23.873579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:23.904038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553e9c-d392-4146-a903-c13c9cc5fb16 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.948379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:23.950289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:23.950858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:23.951384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:23.965328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:23.967391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:23.990007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:23.991157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:23.992342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:23.992342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:23.992342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:23.992342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:23.992624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47072d-8415-408d-9579-816a9e9a8bdb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:23.994824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 441/896] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:24.001414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.029758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.035191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.035958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.049673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 456/897] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:24.050108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.124738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834b8-061d-401a-b10e-b5e84d484165 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.139545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.162091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.162995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.163284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.163630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.164716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:24.164936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.166444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.184350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 442/898] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:24.185668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.186371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42659b6c-761e-4bfc-b84e-62e3606ab839 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.229831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89691816-0661-4302-9e5a-248f4594310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.231114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89691816-0661-4302-9e5a-248f4594310b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.231857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89691816-0661-4302-9e5a-248f4594310b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.232334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89691816-0661-4302-9e5a-248f4594310b None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.233211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89691816-0661-4302-9e5a-248f4594310b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:24.233825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89691816-0661-4302-9e5a-248f4594310b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.236028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89691816-0661-4302-9e5a-248f4594310b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.243013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 457/899] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:24.248968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89691816-0661-4302-9e5a-248f4594310b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.301209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2ab8-c31f-4945-b2c4-9ce609fe5ec1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.329251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.357415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.358775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.359255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.359597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.370865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.372717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.380801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89691816-0661-4302-9e5a-248f4594310b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:24.393623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:24.394644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:24.395582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:24.400407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 443/900] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:24.402684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.432156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.433302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.433834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.434456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.435587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] RBAC: Adding query filter params (interface=public, service_id=2ada8b515a6e42298a8d1639b00f070d, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:24.436109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.437929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.442431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.448537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 458/901] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/endpoints?service_id=2ada8b515a6e42298a8d1639b00f070d&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:24.454003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.536603 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3810f7-9356-40e3-9f1f-b9745ac2678b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.585147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8cfb0-0efa-426c-bde5-6233d2402fab None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.587266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.588009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.588981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.588981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.589588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:24.589956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.591460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a84aa-0c77-40b2-829b-3b72acefa2e9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.611137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.612757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 444/902] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:24.614332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bafb6-6096-4bc9-84db-b1d2985f908b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.614651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bafb6-6096-4bc9-84db-b1d2985f908b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.614930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bafb6-6096-4bc9-84db-b1d2985f908b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.616169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 445/903] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:24.619984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bafb6-6096-4bc9-84db-b1d2985f908b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.629705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.630828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.631113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.631390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.632134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.634165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35859b-eec7-4fb5-8064-286db6822463 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.647908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 459/904] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 11:58:24.647908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327218df-0305-4087-a724-051433591a79 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.647908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327218df-0305-4087-a724-051433591a79 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.647908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327218df-0305-4087-a724-051433591a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.665181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-327218df-0305-4087-a724-051433591a79 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:24.666810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-327218df-0305-4087-a724-051433591a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:24.746367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.756648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 460/905] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:24.764927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bafb6-6096-4bc9-84db-b1d2985f908b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.779209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327218df-0305-4087-a724-051433591a79 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:24.808451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.809477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.810001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.810613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.901816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327218df-0305-4087-a724-051433591a79 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:24.903951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.906509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.921584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.939898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:24.940877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.941262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.941654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.942475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:24.944520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:24.957897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:24.959271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:58:24.960374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:24.967461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 461/906] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:24.968185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.019761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.031598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 446/907] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:25.037666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.094198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4467e7-f184-4bd3-86ac-bc3e6ebcf7bb None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.130035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.131210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.131495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.131765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.132503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:25.132803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.134159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.143648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 462/908] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:25.144761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.162104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9cac-bb4e-4902-9415-255bf942479a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.193730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.207985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.210387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.210387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.211055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.223884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.226201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:25.249837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:25.257499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:25.258406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:25.258406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:25.258406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:25.258406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:25.258627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ab8c-2b69-42db-a7b4-6b59378fbfba None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.258701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 447/909] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:25.259571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.296794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.297703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.298126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.298684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.302731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:25.302731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.302731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.313509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 463/910] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:25.315501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.315975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.408826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4dbf2-22ce-44d3-9008-39b1d13a58ee None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.441658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bfba7-0420-4039-a13f-125ff5e6a54f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.446429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.447099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.447377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.447652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.448401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:25.448705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.450087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.456237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.467654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 448/911] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:25.469067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.485785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.487184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.487881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.488334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.489469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.491570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.578303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 464/912] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:25.587151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95faf-b7a5-47f6-ac3d-1447af3a0e37 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.589106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.633408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.634200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.634480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.634751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.642923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.644476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:25.660189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:25.661142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:25.662585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:25.666505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 449/913] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:25.668373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.789871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3019-639c-4832-9dd3-2e0af9c0cfe9 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:25.830517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:25.831519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.832035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.832531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.833625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:25.834144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:25.835745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8af6f-17cd-4d5d-a5f3-dffe44377571 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:25.848757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 465/914] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:25.854538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:25.901764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884716-4e63-4203-a547-9c04a472042f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.902400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884716-4e63-4203-a547-9c04a472042f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.902881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884716-4e63-4203-a547-9c04a472042f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.904725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 466/915] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:25.909762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:25.910355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:25.910869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:25.928766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:25.930538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:25.952912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:25.975867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d277-c338-48ef-9fac-8c246dec00fd None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:26.012235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 467/916] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:26.020179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:26.021546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.021849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.022157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.022978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] RBAC: Adding query filter params (role.id=c2de2448977445c596ab13dbbdc7aa34, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5a997ab3c1b44133ba74d2f514cf2979) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:26.023332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:26.024955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f798-c4bd-44fe-9735-058a6d1074a1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:26.036367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 450/917] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:25 2022] GET /identity/v3/role_assignments?user.id=5a997ab3c1b44133ba74d2f514cf2979&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=c2de2448977445c596ab13dbbdc7aa34 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:26.037401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:26.157926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ec924-4e7e-4104-a913-bc6be1131e08 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:26.199062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:26.200109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.200619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.201107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.202031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:26.203614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fe464-c546-4910-b15e-8e422e281b63 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:26.286289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 468/918] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:26 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:26.918787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11904009-2813-4901-bc04-c5c8ab0887a2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.919187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11904009-2813-4901-bc04-c5c8ab0887a2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.919364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11904009-2813-4901-bc04-c5c8ab0887a2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.920952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 451/919] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:26.926281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.926575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.926851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.944647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:26.945829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:26.957217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:27.019304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 469/920] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:27.042948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11904009-2813-4901-bc04-c5c8ab0887a2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:27.068497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:27.153388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11904009-2813-4901-bc04-c5c8ab0887a2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:27.189562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:27.190311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.190592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.190861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.191527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:27.193703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:27.207572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:27.209263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:27.210095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 452/921] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 19 11:58:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:27.215813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:27.316772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914cb2-2f73-46d5-8edb-97552244a65f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:27.352701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:27.353363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.353644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.353914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.354609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:27.354908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:27.356291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:27.361416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 470/922] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:27.367464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:27.456781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:27.472309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200182c-12bd-4bd3-94cc-6db95aa1a7e1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:27.517777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:27.518446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.518721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.518992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.519694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:27.519996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:27.521939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc759fef-2d82-45ed-96fa-046392f0bdfa None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:27.527647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 453/923] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:27.533167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:27.548695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:27.638225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f33c3-102e-4ba7-8c86-1a72576bdb15 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:27.673840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:27.674508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.674787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.675046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.675797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:27.677208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf41c63-495f-4620-98e5-3f15021948d0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:27.789010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 471/924] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:27.974426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae303178-bd37-4bdc-aef1-da92b113daa9 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.975129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae303178-bd37-4bdc-aef1-da92b113daa9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.975616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae303178-bd37-4bdc-aef1-da92b113daa9 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.977454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 454/925] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:27.982702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.982988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.983260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.001288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:28.002483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:28.067500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:28.084103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 472/926] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:28.108718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae303178-bd37-4bdc-aef1-da92b113daa9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.223390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae303178-bd37-4bdc-aef1-da92b113daa9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.260070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.260818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.261103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.261377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.262084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:28.263517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:28.264902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING keystone.server.flask.common [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 11:58:28.313451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.sql.core [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:58:28.313451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:58:28.313451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [parameters: {'id': '5f0cca675e124e5bbfe7ac2d1d495039', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:58:28.313451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-8693612f-e7d4-4c20-8715-81e9c949432c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f0cca675e124e5bbfe7ac2d1d495039.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f0cca675e124e5bbfe7ac2d1d495039. May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:58:28.321619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 11:58:28.322435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application yield resource May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise self.value May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application session.commit() May 19 11:58:28.323408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.flush() May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application compat.raise_( May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:58:28.324362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:58:28.325288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:58:28.326107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [parameters: {'id': '5f0cca675e124e5bbfe7ac2d1d495039', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.327005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:28.327803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f0cca675e124e5bbfe7ac2d1d495039. May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.330607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 455/927] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 19 11:58:28 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:28.332490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.342772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53932-2065-462b-8275-5079642b29c6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.343062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53932-2065-462b-8275-5079642b29c6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.343343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53932-2065-462b-8275-5079642b29c6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.348084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 456/928] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:28.354427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.355067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.355548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.373439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:28.381796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:28.383675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:28.442135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c9362-f4c1-4fa6-81a8-ed593f188a0f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.483393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 457/929] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:28.494440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.495499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.495956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.496428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.503826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:28.506171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:28.507948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:28.525006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:28.525997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:28.526937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:28.532666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 473/930] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:28.533718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.588571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:28.642657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1870319-103c-45b2-82ba-9ff7e9d59e06 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.643630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91ff82-3020-4bce-9751-a64aeade3ad5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.677382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.678185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.678459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.678724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.681601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:28.682623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.683480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.683930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.684411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.685510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:28.685984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:28.687619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec14bc-73c3-451b-9387-62a0d8023e01 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:28.690723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e678d65c-7ffb-4713-892d-f2d718029a90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:28.698004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:28.699116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:28.700454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 458/931] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:28.701152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432fc9-c7c1-4c80-b39d-1bb160f101ba None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.701152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432fc9-c7c1-4c80-b39d-1bb160f101ba None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.701499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432fc9-c7c1-4c80-b39d-1bb160f101ba None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.702766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 459/932] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:28.707599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432fc9-c7c1-4c80-b39d-1bb160f101ba None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.724565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 474/933] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:28.724565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.724565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.724565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.746705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:28.748029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:28.836250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432fc9-c7c1-4c80-b39d-1bb160f101ba None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.859236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 475/934] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:28.883342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.885784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.886916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.887451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.887942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.889046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:28.889551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:28.891286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:28.903375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 460/935] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:28.909187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.929615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:28.988583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.013992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fd6c1-cf70-4236-a27b-aae9c22aab82 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.048298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8abb8-faf7-4943-bfcb-272c82988b55 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.054219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.055289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.055568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.055839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.056534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.057903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:29.070654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:29.071680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:29.072534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:29.076525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 476/936] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:29.078133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.091809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.092985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.093489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.093953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.104957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.106720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:29.126214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:29.127568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:29.128507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:29.128507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:29.128507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:29.128507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:29.130973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 461/937] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:29.140250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.185639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dc35a-52a1-4e55-a674-81d69d0b7183 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.187303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.227075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.228352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.229296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.230437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.231331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:29.232060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.234763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.241492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 477/938] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:29.246633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.270194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af403-8d11-4620-ab40-2ff1fe7027cb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.282763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.312154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.312916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.313490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.313602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.314309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:29.314613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.315980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.333523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 462/939] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:29.335882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.387435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04fcae-3f7b-4467-8afa-d19e6569b0a8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.422858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.423573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.423857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.424128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.424885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:29.425185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.426546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.435657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 478/940] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:29.441827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.466887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455d41-04c4-45b7-9c77-4866d7d95cff None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.475625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.502252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.503119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.503323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.503597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.513504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.515052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:29.531512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:29.532775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:29.533716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 463/941] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:29.539135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.555595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555645-4e64-49bb-90b3-f34da4a6369e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.582918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.593893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.594973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.595430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.595909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.596960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] RBAC: Adding query filter params (interface=public, service_id=91703ecd4bbe47e88638430ee8dacdf2, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:29.597473 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.599087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.610017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 479/942] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/endpoints?service_id=91703ecd4bbe47e88638430ee8dacdf2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:29.611184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.672815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1469-e941-4653-809c-6165b3cd3c7d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.713644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.714335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.714618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.714890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.715979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.716853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:29.717189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.719391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.723498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b65d3-f34c-4a2f-856b-70dc6b804204 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.748361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 464/943] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:29.750507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.765396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.766053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.766330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.766596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.767260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.768783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.784372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 480/944] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:58:29.858944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:29.873735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05073-84a3-4db7-8d84-0c684d589dfb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.914324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.915670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.916190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.916717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.930978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.932930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4198706d-55d4-4afd-a37b-feeda95613dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:29.954209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:29.955216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:29.956119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:29.956119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:29.956119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:29.956119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:29.958159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 465/945] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:29.964950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.071227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597195f-13e8-413a-af73-39af7efbbfa5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.097630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bc14b-4d09-49f2-88cf-60c24169c7a1 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.097972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bc14b-4d09-49f2-88cf-60c24169c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.098185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bc14b-4d09-49f2-88cf-60c24169c7a1 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.100246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 466/946] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:30.105389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.105910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.106378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.110100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.110767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.111050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.111323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.112047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:30.112387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.114007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.125261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:30.127043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:30.129086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 481/947] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:30.135171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.153973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:30.208513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 467/948] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:30.223199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.244418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410b27-773e-4c33-b8d6-291ed906b494 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.282049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.282760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.283037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.283306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.291148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.292715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.296507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:30.309075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:30.310023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:30.311180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 482/949] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:30.316044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.344235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3bcd5-c65c-42e1-b590-6795f1d0d7c3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.376411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.377348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.377727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.378096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.378841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.380430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:30.392585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:30.393714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:30.394833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 468/950] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:30.405946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.420443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:30.444115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1363a4-0c59-4683-a379-d778f27c72e2 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.480548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.481455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.481921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.482330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.483269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:30.483713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.485297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.499113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 483/951] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:30.506880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.524883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb8ec-8d30-4f87-9afd-057d9ef5711a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.569827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.571202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.571871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.572349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.573456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:30.573907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.575826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.577419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:30.588213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 469/952] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:30.591490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.650141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0359-affb-4a52-9389-0cc2ce8940b8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.694200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.695514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.695797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.696069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5a997ab3c1b44133ba74d2f514cf2979/roles/c2de2448977445c596ab13dbbdc7aa34` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.698982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=5a997ab3c1b44133ba74d2f514cf2979, role_id=c2de2448977445c596ab13dbbdc7aa34)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.700641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec49f7-c3a1-4245-9fbf-520fc54c068a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.721737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d5a59-b400-473b-8a31-51d687a5d3d9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.758707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.759721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.760297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.760769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.761649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:30.762144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.763757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349713fc-bd76-4431-bbba-a41fe9011750 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.774627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 470/953] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:30.800263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:30.806386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 484/954] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:30 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/5a997ab3c1b44133ba74d2f514cf2979/roles/c2de2448977445c596ab13dbbdc7aa34 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:58:31.104271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31807d8-07c8-45e8-ba1c-c9d110886d61 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.104590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31807d8-07c8-45e8-ba1c-c9d110886d61 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.104773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31807d8-07c8-45e8-ba1c-c9d110886d61 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.106307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 471/955] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:31.111802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.112371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.112852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.130611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:31.132094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:31.211149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 485/956] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:31.235508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31807d8-07c8-45e8-ba1c-c9d110886d61 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:31.305165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:31.353795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31807d8-07c8-45e8-ba1c-c9d110886d61 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:31.391386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:31.391977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.392324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.392612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.393325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:31.394771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:31.450362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.sql.core [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:58:31.450362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:58:31.450362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [parameters: {'user_id': '94407f4df99341eda155471990c062e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:58:31.450362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:58:31.458764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:58:31.459625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application yield resource May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application next(self.gen) May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise self.value May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application session.commit() May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:58:31.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.session.flush() May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application compat.raise_( May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:58:31.461507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:58:31.463682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application conn.query(q) May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application result.read() May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:58:31.465647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [parameters: {'user_id': '94407f4df99341eda155471990c062e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:31.467619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 11:58:31.469347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:31.476629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 472/957] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 19 11:58:31 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:31.477480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:31.569760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b323b-0123-47d4-bc7a-3a75f3829957 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:31.604617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:31.609210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:31.610007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.610343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.610613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.618778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:31.620241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-792ae815-f013-4e5b-b4e3-b6cd070f681e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:31.635430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:31.637627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:31.639645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 486/958] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:31.644284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:31.751885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878131-bb24-4c47-810d-73961f36436e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:31.776440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:31.787951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:31.788667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.788953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.789229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.790033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:31.790378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:31.792053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38bde9-984f-44e7-9ffc-0a2449011daf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:31.831012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 473/959] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 19 11:58:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:32.153948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573298-0ead-4b13-96c3-687cfea0f95a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.154249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573298-0ead-4b13-96c3-687cfea0f95a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.154614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573298-0ead-4b13-96c3-687cfea0f95a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.156027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 487/960] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:32.162024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.162312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.162586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.180073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:32.181587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:32.252168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 474/961] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:32.275340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573298-0ead-4b13-96c3-687cfea0f95a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:32.384651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573298-0ead-4b13-96c3-687cfea0f95a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:32.419718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:32.420514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.420795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.421066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.421764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:32.423118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:32.435816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:32.437017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:32.438200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:32.440276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 488/962] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:32.443842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:32.543500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428a59-c92c-480d-a18d-3df32d3f00a2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:32.557565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:32.580271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:32.580943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.581224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.581500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.582203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:32.582509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:32.584512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:32.594057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 475/963] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:32.595630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:32.649730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:32.698848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043c4d-1861-4097-aed0-188a0d1a8125 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:32.732010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:32.732789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.733075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.733348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.734048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:32.734409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:32.735766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914993a5-6062-44c6-af9d-f6a575aed5de None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:32.745740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 489/964] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:32.747274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:32.846880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a298-2ac4-49da-ac4c-8c527f2c417a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:32.880802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:32.881650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.881938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.882355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.883701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:32.885795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f4b09-d4b1-4e48-8a0c-5d521877e124 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:32.942620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 476/965] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:33.079961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909ab2-c1a6-4a02-ad72-43806c260cb3 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.080364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909ab2-c1a6-4a02-ad72-43806c260cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.080536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909ab2-c1a6-4a02-ad72-43806c260cb3 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.082124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 490/966] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:33.087711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.088001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.088316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.106678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:33.107870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:33.138353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:33.179370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439bd-bac2-489a-8e53-6ab37cbde2c1 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.180471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439bd-bac2-489a-8e53-6ab37cbde2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.180471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439bd-bac2-489a-8e53-6ab37cbde2c1 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.181553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 491/967] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:33.186945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.187232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.187508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.190429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 477/968] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:33.205800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:33.206986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:33.213555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.288243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 492/969] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:33.311312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.325044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbee56-6eb7-4f8f-82fb-2085b12ff914 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.365276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.365933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.366211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.366474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.367190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:33.367665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:33.368584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:33.419212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d641c0-21ac-48e2-b688-dcdd5cee0b89 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.453930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.454729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.455008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.455277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.465416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:33.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:33.474669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:33.475538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 493/970] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:33.480623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.486114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 478/971] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:33 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:33.589542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f018-bd12-451e-b41f-5d197e1d5f28 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.597041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:33.634281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.634951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.635226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.635494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.636292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:33.636596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:33.637998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:33.651486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 494/972] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:33.652906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.673874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:33.760904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06108d0-3b7c-4450-bfde-0adbb6ad5819 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.796155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.796999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.797284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.797557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.808944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:33.810438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:33.835475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:33.836478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:33.837409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:33.837409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:33.837409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:33.837409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:33.837409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 479/973] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:33.843413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.945970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee667-08f3-4472-810d-16b69a5fc421 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.978655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.979315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.979594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.979865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.980605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:33.980909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:33.982259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:33.994038 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 495/974] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:33.999340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:34.069217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:34.099256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200220-73ce-4f8b-a223-d7ece8a9fcf1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:34.137413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:34.138375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.138763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.139142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.146703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:34.148299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:34.163416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:34.164697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:34.165786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 480/975] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:34.171983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:34.199099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:34.275489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1129-92d4-460f-98cd-8bbd396f37ca None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:34.311250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:34.311921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.312216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.312499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.313331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:34.313637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:34.315052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:34.336634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 496/976] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 19 11:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:34.341987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:34.441084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7667e-66e2-47e2-9313-c09ae0289a16 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:34.469668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:34.476280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:34.476923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.479749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.479749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.544667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:34.546117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:34.649121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 481/977] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:34 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:58:34.650432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:34.732494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:34.751194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e86-4bf1-4e8b-b7da-74ea8fe7a292 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:34.785664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:34.786992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.787272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.787543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.797532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:34.798956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:34.816404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:34.817365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:34.823606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:34.823606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:34.823606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:34.823606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:34.823606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 497/978] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:34.823899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:34.854001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:34.923311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2953-717d-4b7c-952b-1cc4b1c21563 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:34.956875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:34.957533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.957812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.958612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.959319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:34.959620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:34.961021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:34.976250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 482/979] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:34.978184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.083601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b960ce-dbee-437e-8f56-d4ddb7057253 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.117687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.118474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.118753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.119024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.120915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.126649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.128171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6a8b20a4-f662-44cc-9cf8-4c4bc0c8726f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:35.142090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:35.149184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:35.150131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 498/980] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:35.150632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.227041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2969-fab1-43e8-bd81-ede67e6dd071 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.227369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2969-fab1-43e8-bd81-ede67e6dd071 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.227597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2969-fab1-43e8-bd81-ede67e6dd071 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.229137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 499/981] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:35.234051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.234341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.234620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.245422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.251323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:35.254769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:35.255515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a091-b4b8-4435-adcb-51bdc3a48cf7 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.291057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.291717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.292001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.292300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.293078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:35.293385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.294828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.311430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 483/982] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:35.312787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.327421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 500/983] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:35.350673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.423201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6955b-182c-45ca-822a-3a4095435bbc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.455857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4ed7-c5e8-40a5-b8cc-60a877f8e89d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.467624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.468301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.468577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.468846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.469659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] RBAC: Adding query filter params (role.id=c2de2448977445c596ab13dbbdc7aa34, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=5a997ab3c1b44133ba74d2f514cf2979) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:35.469963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.471389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.477997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 484/984] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/role_assignments?user.id=5a997ab3c1b44133ba74d2f514cf2979&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=c2de2448977445c596ab13dbbdc7aa34 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:35.480880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.492534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.497896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.497896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.497896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.497896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.497896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:35.510007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:35.511118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:35.517357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 501/985] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:35.520230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.538246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.635460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff2f1-9667-4283-a54a-141ddbac3319 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.673195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.673195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.673195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.673195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.673777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:35.674641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.676237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e315a9-48f6-4ebf-b9ac-8df2e54138a4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.682087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 485/986] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:35.687786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.751434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf61c9-7768-4a22-82b7-325046574c71 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.751757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf61c9-7768-4a22-82b7-325046574c71 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.751983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf61c9-7768-4a22-82b7-325046574c71 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.755063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 486/987] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:35.758699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.758984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.759262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.778973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:35.780149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:35.795954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fce126-b1c0-4ea8-9a0e-b43cff35b389 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.831888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.832653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.832937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.833741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.834439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:35.834746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.836109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.846017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 502/988] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:35.846888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.856263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 487/989] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:35.878520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.890539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.902856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:35.949785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4e1a0-9702-4792-9143-464fe1297495 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.986972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.987924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.988306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.988624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.989463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=91703ecd4bbe47e88638430ee8dacdf2, region_id=RegionOne) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:35.989774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.991140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.992401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee92b-e203-417c-b2c7-371acf249941 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.000779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 503/990] 10.222.0.60 () {56 vars in 1249 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/endpoints?service_id=91703ecd4bbe47e88638430ee8dacdf2&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:36.002077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.029505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.030308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.030562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.030831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.031475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.032887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:36.053405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:36.054425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:36.055577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:36.057248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 488/991] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:36.060899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.111616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11782-606e-4a4b-8621-7907c28113c1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.128077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:36.142158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:36.146278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.146944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.149835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.149835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.149835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.149835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.155775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 504/992] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 11:58:36.173330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685367e2-b7cc-4223-a177-5327548f81ac None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.211871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.212612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.212896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.213172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.213894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:36.214203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.215679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.226655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 489/993] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:36.228479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.351226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb078-73c5-4287-8ca7-61a4de21245e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.387155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.387821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.388104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.388414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.389113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:36.389417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.390772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.396743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 505/994] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:36.402494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.503322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929fc7-1ea5-4463-aff3-cca2b2eb07d1 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.537047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.537699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.537979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.538251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.539021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] RBAC: Adding query filter params (interface=public, service_id=c5355fb553114a93a4989cebbb8748fd, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:36.539329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.540721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f14100-aed5-4f3d-a5cf-68f1321b1d6d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.543079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:36.551106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 490/995] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/endpoints?service_id=c5355fb553114a93a4989cebbb8748fd&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:36.552651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.601906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:36.658415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec2-1d28-4492-afe3-9a8b4d96fbfd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.694062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.694823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.695061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.695438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.696149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.697539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572175c8-8dd1-4d49-bbb0-368ffe77258a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.703776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 506/996] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:58:37.760312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557c81-1ede-471d-8df1-86cf6905bccb None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:37.761029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557c81-1ede-471d-8df1-86cf6905bccb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:37.761029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557c81-1ede-471d-8df1-86cf6905bccb None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:37.762396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 491/997] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:37.767560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:37.768021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:37.768184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:37.784933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:37.786631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:37.855120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 507/998] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:37.876780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557c81-1ede-471d-8df1-86cf6905bccb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:37.979483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557c81-1ede-471d-8df1-86cf6905bccb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.012823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.013547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.013831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.014107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.014758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.016131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:38.028223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:38.029216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:38.030075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:38.032280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 492/999] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 19 11:58:37 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:38.035626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.076269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:38.134552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1be1-bf73-4254-a22f-e56febfb2bed None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.168533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.169185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.169462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.169729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.170413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] RBAC: Adding query filter params (name=image) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:38.170709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.172050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6894f7-60df-47bd-8226-86d02fb3ce11 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.181891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 508/1000] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:38.183386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.251257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:38.289156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6250-eee5-43c0-8656-041a2da4bfc4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.389637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.390548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.391009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.391425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.392286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] RBAC: Adding query filter params (type=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:38.392728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.394246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de7b02-37a9-48fb-b8fd-8d1365a6d81e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.398991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 493/1001] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:38.411906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466448b-11ee-439b-8611-46a5ad5a9460 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.412258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466448b-11ee-439b-8611-46a5ad5a9460 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.412504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466448b-11ee-439b-8611-46a5ad5a9460 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.413933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 509/1002] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:38.419946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.420321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.420546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.439682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:38.440947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:38.518283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 494/1003] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:38.541763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466448b-11ee-439b-8611-46a5ad5a9460 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.647009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466448b-11ee-439b-8611-46a5ad5a9460 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.648579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:38.680587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.681408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.681688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.681959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.682603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.683959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:38.697129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:38.698135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:38.699000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 510/1004] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:38.704311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.766839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:38.813369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd841e68-aaf1-4013-bc49-ef8856a95ab3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.849826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.850494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.850795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.851066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.851765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:38.852068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.853464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cc47f-fd4a-429e-bd8c-5057cc52601a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.858429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 495/1005] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:38.863978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.916720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7ea7-b40c-4131-bd1f-d9c3eb38e831 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.917054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7ea7-b40c-4131-bd1f-d9c3eb38e831 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.917276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7ea7-b40c-4131-bd1f-d9c3eb38e831 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.918654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 496/1006] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:38.923654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.923944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.924243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.940882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:38.942052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:38.971031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e74-a00f-41cd-80bc-631fdcc3607b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.008889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.009564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.009820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.010122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.010776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:39.011075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.012454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.016515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 497/1007] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:39.020236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 511/1008] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:39.022901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:39.033655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:39.066186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:39.085775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:39.138125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6336bc3-8c63-4c83-a0e6-77e0e23ea1d1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.139605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481133-b4d1-4fe5-874f-4e0058e92e76 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.173776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.174433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.174711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.174981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.175717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.177118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.177221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.177907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.178180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.178453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.179092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.180721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:39.192923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:39.194136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:39.195478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 512/1009] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:39.199948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:39.284042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 498/1010] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:39.299994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:39.308028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf29da-3f64-4791-9eb0-09f805896dd1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.360806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.361496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.361779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.362054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.362812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:39.363232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.365042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.370804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 513/1011] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:39.376542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:39.493167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdb4e-24bd-42ec-842e-e58ce6fde266 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.506518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:39.530177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.530874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.531157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.531434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.532160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:39.532528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.533962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c914d-b5db-4eaf-9528-a3585b4826f8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.540695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 499/1012] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 19 11:58:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:39.546665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:39.649941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb448-ae0a-4d31-ba95-e8e506ff280a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:39.684074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:39.684997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:39.685430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:39.685851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:39.686771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:39.688312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1ea47-791e-4f8d-8247-1642b79b7b94 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:39.748795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 514/1013] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:40.638002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004ce-98f0-4673-a54c-3d8221e283c5 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.638589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004ce-98f0-4673-a54c-3d8221e283c5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.638589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004ce-98f0-4673-a54c-3d8221e283c5 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.639998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 500/1014] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:40.645149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b17c8-3e3b-4585-b366-3b7b9840d816 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.646114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b17c8-3e3b-4585-b366-3b7b9840d816 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.646309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b17c8-3e3b-4585-b366-3b7b9840d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.662719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c99b17c8-3e3b-4585-b366-3b7b9840d816 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:40.663876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c99b17c8-3e3b-4585-b366-3b7b9840d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:40.667331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:40.736369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 515/1015] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:40 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:40.759262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c004ce-98f0-4673-a54c-3d8221e283c5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:40.860566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c004ce-98f0-4673-a54c-3d8221e283c5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:40.893745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:40.894324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.894602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.894876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.896103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:40.897495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cfc38-3881-43fc-9888-6e14db9d64ee None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:40.994874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 501/1016] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:40 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:41.569067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd87f-5518-4c7a-952a-7355a50d42aa None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:41.569414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd87f-5518-4c7a-952a-7355a50d42aa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:41.569625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd87f-5518-4c7a-952a-7355a50d42aa None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:41.571033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 516/1017] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:41.576269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:41.576565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:41.576841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:41.594905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:41.596008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:41.625609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:41.670554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 502/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:41.693804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bd87f-5518-4c7a-952a-7355a50d42aa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:41.798625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bd87f-5518-4c7a-952a-7355a50d42aa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:41.832568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:41.833907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:41.834184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:41.834455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:41.835631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:41.837103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911234fc-89cd-4074-8671-b5589601ec7a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:41.843402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 517/1019] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:41.844662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:41.947786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27de581-6774-4b7e-a3e0-6886b63bbed9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:41.983797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:41.984486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:41.984769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:41.985042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:41.985765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:41.987210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a14d38-6164-4956-b5a9-e71e45a06bda None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:42.086199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 503/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:58:41 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:42.124860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642f253-d9e6-409e-827a-1945298d6efd None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.125167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642f253-d9e6-409e-827a-1945298d6efd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.125406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642f253-d9e6-409e-827a-1945298d6efd None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.127092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 518/1021] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:42.132990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.133306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.133554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.151720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:42.152972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:42.164994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:42.230559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 504/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:42.250013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642f253-d9e6-409e-827a-1945298d6efd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:42.254061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:42.360905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642f253-d9e6-409e-827a-1945298d6efd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:42.394395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:42.395197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.396009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.396311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.406094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:42.414778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:42.415709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:42.417050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 519/1023] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:42.421927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:42.523151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d164a-229a-44ba-9a71-18546ecb560c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:42.557320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:42.557994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.558278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.558550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.559290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:42.559592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:42.560990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:42.574614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 505/1024] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:42.575872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:42.638221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:42.678346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d849-01e3-46dd-a2b8-90990a7a4672 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:42.712022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:42.712882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.713117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.713384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.724515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:42.725946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:42.743245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:42.744171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:42.745118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:42.745118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:42.745118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:42.745118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:42.745118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 520/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:42.753423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:42.763080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:42.854030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086079bd-a752-4683-9da6-94f6a5d63625 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:42.887571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:42.888252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:42.888542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:42.888813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:42.889519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:42.889821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:42.891192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:42.907558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 506/1026] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:42.908851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.010069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af457-92ca-47ba-9f45-54dc9246707c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.026012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.043917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.044725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.045008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.045279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.052666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.054134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:43.070530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:43.071562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:43.077796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 521/1027] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:58:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:43.078445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.145340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.180063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dba5b-e925-4e34-939b-ab2eda7d6518 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.211897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.212581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.212860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.213129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.213952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:43.214257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.215967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435d15-736e-4e7a-8bff-dd3d2b96e323 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.237988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 507/1028] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:43.239812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.250690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea650a9-0fd6-455b-a2a6-41333ad120ff None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.251005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea650a9-0fd6-455b-a2a6-41333ad120ff None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.251240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea650a9-0fd6-455b-a2a6-41333ad120ff None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.252814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 508/1029] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:43.258194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.261113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.261113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.275969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:43.277182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:43.350413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0e67-1eeb-498f-b4f6-f5cd49adee42 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.352234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 509/1030] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:43.375034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.389625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.390604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.390953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.391225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.434489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.439618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.464571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.466220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.481068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d8c2-faa3-4f6e-bd6b-841fdd006683 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.516533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.517430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.517707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.517975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] PATH_INFO: `/v3/services/image` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.518612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.520092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:43.532469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:43.533502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:43.534375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 510/1031] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:43.540313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.569775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 522/1032] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:58:43.575097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.648028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa6747-de83-4603-9c8e-f57e2fd6bbfe None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.654552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.665510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.676794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99998749-7d90-417c-8a0c-4a4561ef0da1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.682633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.683288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.683565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.683834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.684613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] RBAC: Adding query filter params (name=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:43.684854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.686223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.692725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 511/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:43.698362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.712476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.713882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.714371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.714818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.726091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.727777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:43.745898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:43.747028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:43.748166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:43.748166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:43.748166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:43.748166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:43.754171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 523/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:43.755647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.803648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba346ba-705a-4217-ac24-24ad088a8982 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.843904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.844862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.845246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.845517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.846232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] RBAC: Adding query filter params (type=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:43.846534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.847896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.852897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 512/1035] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:43.858568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.860937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe844-76f0-4976-8a47-a3f41516d060 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.888671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.897421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.898146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.898437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.898733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.899396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:43.899696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.901084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.907671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:43.912411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 524/1036] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:43.917576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.965917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fde43-8f5b-4807-93cf-1220a701326b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.999935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.000630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.000912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.001186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.001961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] RBAC: Adding query filter params (interface=public, service_id=7ac35f41bac34d97960940a70d57f6bb, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.002272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.003632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.009693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 513/1037] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/endpoints?service_id=7ac35f41bac34d97960940a70d57f6bb&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:44.015246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.026384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1383-d5bc-4efd-b0fe-35603b1cd462 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.066101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.066887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.067188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.067559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.074269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.075690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:44.090225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:44.091282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:44.092448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 525/1038] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:44.097058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.124900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b045-b986-4a43-b13f-33ae607abb45 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.135932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.146295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.161525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.162178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.162455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.162724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.163395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.164795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.172183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 514/1039] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:58:44.205510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc74f-7263-4339-a35b-5f14ac989327 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.247283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.247872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.248148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.248445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.249239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.249550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.251058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2c9c4-2c26-4aaa-9d70-dc4b8c44a7e8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.264064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 526/1040] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:44.272234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.389848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669acb-3dfb-434d-8401-514e2ddf261e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.408382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637bdfb-8301-46c9-8512-436c353a37b6 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.408672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637bdfb-8301-46c9-8512-436c353a37b6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.408957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637bdfb-8301-46c9-8512-436c353a37b6 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.410596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 527/1041] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:44.415872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.416226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.416503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.426915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.427558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.428305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.428587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.429456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] RBAC: Adding query filter params (role.id=c2de2448977445c596ab13dbbdc7aa34, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.429964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.431392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.433398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:44.434580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:44.438006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 515/1042] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=c2de2448977445c596ab13dbbdc7aa34 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:44.516467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 528/1043] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:44.541586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.585709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.648648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb8abb-9a98-462a-b8aa-8b5ccf24e52c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.682883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.683807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.684223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.684525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.685640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.687067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2247a2d-c70a-4786-9ef9-70d64f617625 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.692842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 516/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:44.695362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.738270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.798646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d1b1-fd21-4ace-89ed-785ecc727555 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.833863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.834525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.834799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.835061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.835747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.837171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744b4da-1db5-4983-820f-f474c145a54c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.928236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 529/1045] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:58:44 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:46.392192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9608-f56d-4181-a2e0-f1a06c404056 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.392716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9608-f56d-4181-a2e0-f1a06c404056 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.392819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9608-f56d-4181-a2e0-f1a06c404056 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.394279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 517/1046] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:46.399371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f009-7f1c-4d97-a90a-7cccca01c505 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.399749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f009-7f1c-4d97-a90a-7cccca01c505 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.399918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f009-7f1c-4d97-a90a-7cccca01c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.416189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7505f009-7f1c-4d97-a90a-7cccca01c505 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:46.417367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7505f009-7f1c-4d97-a90a-7cccca01c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:46.489148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 530/1047] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:46.512573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9608-f56d-4181-a2e0-f1a06c404056 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.613125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9608-f56d-4181-a2e0-f1a06c404056 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:46.620355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:46.628548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6055-b73e-46fb-8cf0-a266ccf9bc56 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.628912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6055-b73e-46fb-8cf0-a266ccf9bc56 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.629129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6055-b73e-46fb-8cf0-a266ccf9bc56 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.631173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 531/1048] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:46.635912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.636251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.636499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.650736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:46.651513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.651788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.652059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] PATH_INFO: `/v3/services/image` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.652734 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:46.654112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.655159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:46.656375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:46.666482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:46.667510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:46.668956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 518/1049] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:46.673541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.678165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:46.733190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 532/1050] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:46.756870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.783821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13488-9dd8-496a-8be9-5bc8ff905010 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:46.821049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:46.821722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.822003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.822274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.822966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] RBAC: Adding query filter params (name=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:46.823268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:46.824670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.829891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 519/1051] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:46.835287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.863248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d896b-6045-4194-9f52-00979a5a994d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:46.870566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:46.900678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:46.901747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.902026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.902295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.914455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:46.926271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:46.927792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:46.934042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 533/1052] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:46.935085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.941749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951716d-634e-4feb-a4b4-e0a58e97aabb None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:46.951491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:46.977961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:46.978624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.978895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.979168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.979852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] RBAC: Adding query filter params (type=image) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:46.980151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:46.981550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.986481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 520/1053] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:46.992972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.047332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee804169-d8d2-48ed-998e-4f7fc43ee08d None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.086929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.087592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.087867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.088132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.088906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:47.089204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.090552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.097500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.104351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 534/1054] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:47.104511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bc99e-230d-4f98-b69d-64d838939a00 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.105381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.135442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.136892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.137176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.137451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.138181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.139552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346ba6d-efea-481c-8fb9-3198d91f2905 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.185944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.207578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35afdd-f80c-4ebe-b431-2e2e928d9ff1 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.216428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 521/1055] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 11:58:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:47.232342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b0af-fa31-41a0-a22b-991610df278a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.232583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b0af-fa31-41a0-a22b-991610df278a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.232846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b0af-fa31-41a0-a22b-991610df278a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.234442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 522/1056] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:47.240328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.240634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.241059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.256070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.256907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.257187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.257457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.259453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:47.260755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:47.270048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.272157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:47.293612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:47.294791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:47.295972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:47.295972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:47.295972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:47.295972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:47.302888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 535/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:47.303396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.361486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 523/1058] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:47.381641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.424316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f64db-b12b-43d6-882e-dc9d42087ada None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.453521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.466115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.466773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.467048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.467314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.468022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:47.468353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.470134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.479034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.485737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 536/1059] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:47.491158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.495859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a109e-1e0b-4a91-ab90-c29f33dd195d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.532097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.532922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.533206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.533496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.543857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:47.551547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:47.552578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:47.553464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 524/1060] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:47.558863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.599553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5841-cfb3-49e2-95c4-762bc5a3b2db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.635325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.636247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.636644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.636910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.643982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.646396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:47.663873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:47.665131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:47.666276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 537/1061] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:47.671146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.750750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83432f8e-a3fc-4f72-a9ff-563c716cb87a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.772260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.793299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.794132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.794539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.794913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.795818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:47.796275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.797758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.811972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 525/1062] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:47.813002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.823037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:47.825709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a6a8a-54b1-45c5-900f-e5a13f8ba7bc None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.859954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.860650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.860929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.861197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.862023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:47.862323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.863725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.882507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 538/1063] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:47.887833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.920981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0007e8-03cd-46ea-9ef3-7d95b4addd1c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.958125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:47.959074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:47.959964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:47.959964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] PATH_INFO: `/v3/users/7603e995b503402bab8ec32f4288c663` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:47.974441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] RBAC: Authorizing `identity:get_user(user_id=7603e995b503402bab8ec32f4288c663)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:47.975894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:47.977938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 526/1064] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/users/7603e995b503402bab8ec32f4288c663 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:47.983080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:47.994518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696064d-eaab-479c-a992-ba87a0c68013 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:47.996617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.030836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.031564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.031824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.032440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.043548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.045132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.051563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:48.062713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:48.065245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:48.066161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:48.066161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:48.066161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:48.066161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:48.066161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 539/1065] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:48.069830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.095700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaeae-7091-452a-a603-05cc8108c059 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.131440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.132074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.132408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.132637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.178251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b60ee-7486-4237-b6a7-d657addde7e7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.203407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.205159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.210978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.211625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.211902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.212177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.212910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:48.213209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.214533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.226727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 540/1066] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:48.232234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.249202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.269043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.310428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 527/1067] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:58:48.315743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.349399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feaa0b-c989-4f02-9656-e229bd1fcde7 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.386201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.386992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.387266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.387532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.394210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.396317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:48.412619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:48.413586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:48.414507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:48.418508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 541/1068] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:48.419262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.428978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee407762-9ef7-4a00-ae92-bca8d828ab21 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.467194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.468172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.468499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.468772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.469948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.471389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.473307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 528/1069] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:48.479047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.504096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.511330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.529076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e09a5-5313-4ea5-b0c9-a43cf53d4b96 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.566386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.566386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.566386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.566386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.566829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:48.566829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.567269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.579558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 542/1070] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:48.585691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.585919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb79f9-89bd-4ed9-8c92-f04207801519 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.625940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.626588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.626871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.627135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.627946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=ff32fc3749c4408b91ba0de7070be23f, user.id=7603e995b503402bab8ec32f4288c663) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:48.628278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.629754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f348-7b57-4aad-b15f-75cf611a8fad None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.635218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 529/1071] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/role_assignments?user.id=7603e995b503402bab8ec32f4288c663&scope.project.id=ff32fc3749c4408b91ba0de7070be23f&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:48.700010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a4c9-c426-4aff-ab60-b7db9402d2b5 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.736467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.737356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.737631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.737900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/c2de2448977445c596ab13dbbdc7aa34` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.740179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=fe9f3e7fa6b24e17973f23be244ab083, role_id=c2de2448977445c596ab13dbbdc7aa34)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.741653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66d96f-4658-4486-8647-f38e7e6fea31 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.744071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:48.817794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 543/1072] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:48 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/fe9f3e7fa6b24e17973f23be244ab083/roles/c2de2448977445c596ab13dbbdc7aa34 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:58:49.480702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece755-5ad8-4c87-ab37-5a4e3c8d5cc2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.481238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece755-5ad8-4c87-ab37-5a4e3c8d5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.481238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece755-5ad8-4c87-ab37-5a4e3c8d5cc2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.482760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 530/1073] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:49.487740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.488034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.488348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.505290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:49.506465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:49.574349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 544/1074] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:49.595895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece755-5ad8-4c87-ab37-5a4e3c8d5cc2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.689000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.696737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece755-5ad8-4c87-ab37-5a4e3c8d5cc2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.729408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.730066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.730347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.730622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.800659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.802145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.895792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.902857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 531/1075] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:49.908558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.007604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab1df0-2122-4fd8-a399-b2170f8f7800 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.030561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:50.041605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.042733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.042733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.042911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.052651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.054130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-055c2f2f-dba1-42be-be28-1a1e656d4974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:50.071607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:50.072766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:50.073683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:50.073683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:50.073683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:50.073683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:50.080234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 545/1076] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:50.080387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.177462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014892-508c-4356-b792-e4a98ff93377 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.210897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.211549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.211830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.212103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.212835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:50.213138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.214497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7d594-61c5-414d-99f4-262a2d291401 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.232246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 532/1077] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:50.838691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb5eb-fb63-4604-929b-57ee029240a4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.839277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb5eb-fb63-4604-929b-57ee029240a4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.839277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb5eb-fb63-4604-929b-57ee029240a4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.840685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 546/1078] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:50.846640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c747fd-8fbb-474a-a12c-d673aede73d7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.847165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c747fd-8fbb-474a-a12c-d673aede73d7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.847165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c747fd-8fbb-474a-a12c-d673aede73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.865508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f3c747fd-8fbb-474a-a12c-d673aede73d7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:50.866738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f3c747fd-8fbb-474a-a12c-d673aede73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:50.917712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:50.934308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 533/1079] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:50.956419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb5eb-fb63-4604-929b-57ee029240a4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.029804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745f9c-9bae-44f6-96d9-d4fd0f9e0e68 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.030089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745f9c-9bae-44f6-96d9-d4fd0f9e0e68 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.030365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745f9c-9bae-44f6-96d9-d4fd0f9e0e68 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.031747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 534/1080] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:51.036588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.036869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.037139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.053343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:51.054509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:51.056968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb5eb-fb63-4604-929b-57ee029240a4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.090178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087919d-df25-4361-a34a-72f42195725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.090866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087919d-df25-4361-a34a-72f42195725b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.091138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087919d-df25-4361-a34a-72f42195725b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.091404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087919d-df25-4361-a34a-72f42195725b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.101167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087919d-df25-4361-a34a-72f42195725b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f087919d-df25-4361-a34a-72f42195725b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:51.108662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:51.109696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:51.110585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 547/1081] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:51.115795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087919d-df25-4361-a34a-72f42195725b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.119916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 535/1082] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:51.143063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.149432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.212470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087919d-df25-4361-a34a-72f42195725b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.239560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adfa1f-2b93-4c6e-ac0d-3c8d142c7bc5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.245139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.245792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.246073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.246344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.247073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:51.247371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.248760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.256330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.259102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 548/1083] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:51.264871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.273759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.278561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.278561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.278561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.284982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:51.293683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:51.294658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:51.295531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 536/1084] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:51.300748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.362417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.366730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1f4a4-64cc-49f6-952a-40d66701f895 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.399987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.400893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.401174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.401442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] PATH_INFO: `/v3/users/7603e995b503402bab8ec32f4288c663` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.402632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7603e995b503402bab8ec32f4288c663)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.402912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87bee-4c14-4b1a-9a6f-4c466b95cf38 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.404082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.405738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 549/1085] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/users/7603e995b503402bab8ec32f4288c663 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:51.411394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.436552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.437209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.437489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.437763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.438493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:51.438796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.440159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.447868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 537/1086] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:51.453331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.492363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.507848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3b657-1a32-4e1a-b70b-4ca5942495f0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.540531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.541374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.541648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.541916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.543061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.544535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.546269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 550/1087] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:51.552531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.553231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65ef01-4849-41f8-b212-bae164fe57a5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.584849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.587205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.587998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.588315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.588589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.599196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.600703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:51.618071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:51.619012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:51.620392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:51.620392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:51.620392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:51.620392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:51.620392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 538/1088] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:51.624729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.649343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aa11e-e9f2-48b7-8979-8ca4e3df4aa0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.682434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.683304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.683579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.683845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f/users/7603e995b503402bab8ec32f4288c663/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.685832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff32fc3749c4408b91ba0de7070be23f, user_id=7603e995b503402bab8ec32f4288c663, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.687237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.713565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.722652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edae6-a811-42e4-8607-a82dcdb9af3a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.752787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 551/1089] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:58:51 2022] PUT /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f/users/7603e995b503402bab8ec32f4288c663/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:58:51.759105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.759809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.760313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.761026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.761768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:51.762076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.763599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.776792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 539/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:51.782538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:51.879866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:51.886653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1b4a-4b02-435f-8256-83e5c6998359 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:51.922139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:51.922992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:51.923242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:51.923522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:51.932334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:51.934310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:51.950013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:51.951168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:51.952437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 552/1091] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:51.957221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.056531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211ba0-c39e-40e9-8a59-34e17db34f60 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:52.089545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:52.090223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:52.090496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:52.090769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:52.091596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:52.091903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:52.093381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:52.110478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 540/1092] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 19 11:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:52.116455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.213550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019282-a698-4ecd-a804-360c3e0a1a2a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:52.246136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:52.246774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:52.247048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:52.247315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:52.271050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:52.312997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:52.314468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:52.411221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 553/1093] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:52.417021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.428012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:52.513991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff021c-03c2-4edc-bcd2-4bc130b4fe75 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:52.546465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:52.547241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:52.547516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:52.547799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:52.558404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:52.559839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:52.577461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:52.578445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:52.579901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:52.579901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:52.579901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:52.579901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:52.579901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 541/1094] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:52.584516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.637845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:52.681015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134e36-cdc6-4081-a7bd-7b413aaf683b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:52.714345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:52.714993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:52.715272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:52.715544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:52.716285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:52.716591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:52.717943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:52.728912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 554/1095] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 11:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:52.734354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.792787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:52.832535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368efa4-f1b5-4cbf-b6e1-b5fa6f8194c6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:52.867812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:52.868625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:52.868901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:52.869164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:52.875599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:52.877061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:52.890916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:52.891850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:58:52.892953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 542/1096] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 11:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:52.897779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:52.992836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9adf-ff5a-4f08-9426-9deb41ef4e8b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.005983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.025619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.026265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.026541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.026812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.029244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:53.029244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.029440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea470d-561b-4101-bde8-6695aa5eef06 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.040844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 555/1097] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 11:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:53.046568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.143178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ac9be-9533-4428-bcb7-55f49fb474d5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.162948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.176622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.177264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.177545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.177816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.178625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] RBAC: Adding query filter params (role.id=c2de2448977445c596ab13dbbdc7aa34, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=fe9f3e7fa6b24e17973f23be244ab083) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:53.178931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.180747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acf4da-ff62-4f98-90a1-912fca60228a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.186400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 543/1098] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/role_assignments?user.id=fe9f3e7fa6b24e17973f23be244ab083&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=c2de2448977445c596ab13dbbdc7aa34 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:53.945397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19401-000f-4ce2-8999-c9e724ccc30e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.945920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19401-000f-4ce2-8999-c9e724ccc30e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.946014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19401-000f-4ce2-8999-c9e724ccc30e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.947697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 556/1099] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:53.953207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.953496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.953767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.970839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:53.972002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:54.048540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 544/1100] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:54.071823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19401-000f-4ce2-8999-c9e724ccc30e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.168092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19401-000f-4ce2-8999-c9e724ccc30e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.200574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.201278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.201553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.201821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.211414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:54.218899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:54.219991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:58:54.221056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 557/1101] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:54.226337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.322740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99463-211f-4dc7-b66c-d5caa85a6275 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.336355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.355183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.355840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.356118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.356418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.357194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:54.357497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.358863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.367104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 545/1102] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:54.372749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.406225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.468435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a069728-50ba-45b9-833f-d9f3bc0f618f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.501281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.502134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.502412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.502682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] PATH_INFO: `/v3/users/7603e995b503402bab8ec32f4288c663` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.503829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] RBAC: Authorizing `identity:get_user(user_id=7603e995b503402bab8ec32f4288c663)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.505895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.507488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 558/1103] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/users/7603e995b503402bab8ec32f4288c663 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:54.513087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.608060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7434f53-cd61-4799-a9b5-8dd7e5ada0db None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.641712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.642340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.642616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.642883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.685200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.706307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.708294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.802575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 546/1104] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:54.808643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.904903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb29acb-dc13-498a-b83a-c1e042f361d3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.906400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.938093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.938933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.939210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.939475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.940718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.942164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbdd0b-9e64-46c4-bb96-d63a33d72d95 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.943816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 559/1105] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:54.949927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:55.025765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:55.047179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62374e9-b552-41b7-a448-ffa0168400d6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.079902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.080514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.080791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.081060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.081867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=ff32fc3749c4408b91ba0de7070be23f, user.id=7603e995b503402bab8ec32f4288c663) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:55.082172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.084228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1a42-eeb8-4315-99d1-eb176df6cc3d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.089851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 547/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/role_assignments?user.id=7603e995b503402bab8ec32f4288c663&scope.project.id=ff32fc3749c4408b91ba0de7070be23f&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:57.285079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfe09a-b649-4374-9f81-d75acd24349d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.286110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfe09a-b649-4374-9f81-d75acd24349d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.286110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfe09a-b649-4374-9f81-d75acd24349d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.287471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 560/1107] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:57.292639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.293059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.293196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.310451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:57.311619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:57.377833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 548/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:57.402866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfe09a-b649-4374-9f81-d75acd24349d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:57.499626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfe09a-b649-4374-9f81-d75acd24349d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:57.531240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:57.531997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.532300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.532569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.533703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:57.535152 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e49d3-3da7-40e5-9600-17d5b1462343 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:57.537308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 561/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:57.542956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:57.609544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:57.639468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2ac7-ed33-4ffe-85b0-57f4b12bc17f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:57.673320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:57.673974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.674249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.674516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.675221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:57.677199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1337-6111-44a4-aa09-21c0eef8eb06 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:57.769713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 549/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:58:57 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:58:59.975799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780906c-f1a2-4a2a-8de3-00ddb1cfc470 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.976354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780906c-f1a2-4a2a-8de3-00ddb1cfc470 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.976471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780906c-f1a2-4a2a-8de3-00ddb1cfc470 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.977744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 562/1111] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:59.982855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.983267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.983403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.999572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:00.000762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:00.065616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 550/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:58:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:00.089284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780906c-f1a2-4a2a-8de3-00ddb1cfc470 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.128019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.186391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780906c-f1a2-4a2a-8de3-00ddb1cfc470 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.218437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.219271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.219548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.219815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] PATH_INFO: `/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.221280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] RBAC: Authorizing `identity:get_role(role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.222624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.223943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 563/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:00.229511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.284160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.328903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2aff-db2d-48a7-ae49-108d5301076b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.361988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.362842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.363124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.363399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] PATH_INFO: `/v3/users/2700badc9f4d4fc7b945e94e59eff3b8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.377804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2700badc9f4d4fc7b945e94e59eff3b8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.379267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.381517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 551/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/users/2700badc9f4d4fc7b945e94e59eff3b8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:00.387216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.483007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc12f-1719-47e0-83c1-840ea693de61 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.489481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.514645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.515272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.515550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.515821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.579510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.580962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.673369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 564/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:59:00.679646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.777067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dda26-2f56-496f-8c84-9628687025b2 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.790725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.809845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.810680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.810961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.811230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.812403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.813831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bc7e-1bc2-487e-94c2-a8ace4a51ef3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.815485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 552/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:00.821974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.829816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.917482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e63a3-a6ca-4310-aa05-c4cc7d5b2ef0 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.950521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.951160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.951440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.951709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.952548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=ff32fc3749c4408b91ba0de7070be23f, user.id=2700badc9f4d4fc7b945e94e59eff3b8) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:00.952859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.954257 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ed37-2a03-4539-a626-f4ad773a2b7c None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.960107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 565/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/role_assignments?user.id=2700badc9f4d4fc7b945e94e59eff3b8&scope.project.id=ff32fc3749c4408b91ba0de7070be23f&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.103930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5366-75de-4f3c-9d1f-565c5c7d4648 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.104490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5366-75de-4f3c-9d1f-565c5c7d4648 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.104490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f5366-75de-4f3c-9d1f-565c5c7d4648 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.105862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 553/1118] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:03.110888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.111306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.111438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.128937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:03.130138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:03.189098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.193932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 566/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:03.215959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f5366-75de-4f3c-9d1f-565c5c7d4648 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.313701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f5366-75de-4f3c-9d1f-565c5c7d4648 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.346717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.347557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.347835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.348129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] PATH_INFO: `/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.349592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] RBAC: Authorizing `identity:get_role(role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.350951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.352347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 554/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.357984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.456727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967cf97-555c-45e4-92f4-0c96a0181619 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.488285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.489676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.489954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.490222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] PATH_INFO: `/v3/users/2700badc9f4d4fc7b945e94e59eff3b8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.491386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] RBAC: Authorizing `identity:get_user(user_id=2700badc9f4d4fc7b945e94e59eff3b8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.492826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.494416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 567/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/users/2700badc9f4d4fc7b945e94e59eff3b8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.500083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.548940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.597980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0dd75-b02d-41b8-9103-81ad42331ad8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.631197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.631976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.632291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.632568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.633726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.635139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbf099-2d93-4414-b8d5-7e5730813f01 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.636827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 555/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.642474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.706838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.738335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d31962-61d8-456f-b92d-0034c399c927 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.771826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.772720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.772998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.773268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f/users/2700badc9f4d4fc7b945e94e59eff3b8/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.775416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] RBAC: Authorizing `identity:create_grant(project_id=ff32fc3749c4408b91ba0de7070be23f, user_id=2700badc9f4d4fc7b945e94e59eff3b8, role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.776851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50c5dd-1dad-4f98-a1b9-72ff3b50b9ba None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.842454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 568/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:59:03 2022] PUT /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f/users/2700badc9f4d4fc7b945e94e59eff3b8/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:59:06.017436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee8d7-39dc-4810-9c83-930e8817bf40 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.017967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee8d7-39dc-4810-9c83-930e8817bf40 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.017967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee8d7-39dc-4810-9c83-930e8817bf40 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.019338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 556/1124] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:06.025174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.025603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.025722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.042351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:06.043507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:06.107338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 569/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:06.130301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee8d7-39dc-4810-9c83-930e8817bf40 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.227642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee8d7-39dc-4810-9c83-930e8817bf40 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.244430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.260512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.261349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.263774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.263774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] PATH_INFO: `/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.263774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] RBAC: Authorizing `identity:get_role(role_id=4b2d10ccdb7a4d70b87a44d8083d7e18)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:06.264686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:06.266016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 557/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/roles/4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:06.272393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.327593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.367654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751bae-50cc-4019-a776-1f79b0a0207a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.400259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.401112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.401387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.401656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] PATH_INFO: `/v3/users/2700badc9f4d4fc7b945e94e59eff3b8` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.402798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] RBAC: Authorizing `identity:get_user(user_id=2700badc9f4d4fc7b945e94e59eff3b8)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:06.404229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:06.406087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 570/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/users/2700badc9f4d4fc7b945e94e59eff3b8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:06.411959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.508396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4069f-7b14-4e8d-8306-5c6f09ad76be None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.540983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.541550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.541831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.542103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.595207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.608584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:06.611833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:06.704799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 558/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:06.711094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.805587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd996873-0c1a-4c5e-86a3-fa14645cbd2a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.830541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.839213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.840070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.840356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.846264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] PATH_INFO: `/v3/projects/ff32fc3749c4408b91ba0de7070be23f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.846264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] RBAC: Authorizing `identity:get_project(project_id=ff32fc3749c4408b91ba0de7070be23f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:06.846264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a6c2-a2e5-4474-89f5-a6df80a0d92b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:06.846264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 571/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/projects/ff32fc3749c4408b91ba0de7070be23f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:06.850792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.930815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.945022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c6b2-006d-44b0-8ad7-dc7c71b38e33 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.977077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.977703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.977980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.978250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.979043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] RBAC: Adding query filter params (role.id=4b2d10ccdb7a4d70b87a44d8083d7e18, scope.project.id=ff32fc3749c4408b91ba0de7070be23f, user.id=2700badc9f4d4fc7b945e94e59eff3b8) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:06.979346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:06.980790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65df4-ed65-48dd-92d4-2fbd9db3465f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:06.986292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 559/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/role_assignments?user.id=2700badc9f4d4fc7b945e94e59eff3b8&scope.project.id=ff32fc3749c4408b91ba0de7070be23f&role.id=4b2d10ccdb7a4d70b87a44d8083d7e18 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:09.183737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279b-5943-47a6-a149-6c6d1a447ecc None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:09.184282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279b-5943-47a6-a149-6c6d1a447ecc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:09.184282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279b-5943-47a6-a149-6c6d1a447ecc None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:09.185655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 572/1131] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:09.191067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:09.192017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:09.192119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:09.208986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:09.210161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:09.274751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 560/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:09.297538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950279b-5943-47a6-a149-6c6d1a447ecc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:09.396037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950279b-5943-47a6-a149-6c6d1a447ecc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:09.427763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:09.428551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:09.428830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:09.429099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:09.430502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:09.431902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa1896-f931-44a0-8290-f0f12cfab711 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:09.433509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 573/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:09.439252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:09.516366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:09.534151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c1c04-9991-4a7e-a088-db963c86da00 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:09.567845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:09.568513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:09.568795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:09.569067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:09.569756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:09.571186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8630de-4737-4a3c-bae9-6b165da02fe1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:09.673623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 561/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:59:09 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:11.890617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e9e46-fccd-4a71-a3c8-71aca1b67aac None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:11.891151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e9e46-fccd-4a71-a3c8-71aca1b67aac None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:11.891151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e9e46-fccd-4a71-a3c8-71aca1b67aac None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.892543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 574/1135] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:11.897773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:11.898165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:11.898320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.914616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:11.915786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:11.981151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 562/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:59:12.005608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e9e46-fccd-4a71-a3c8-71aca1b67aac None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:12.066126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:12.104807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e9e46-fccd-4a71-a3c8-71aca1b67aac None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:12.137155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:12.137920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:12.138199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:12.138469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:12.139615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:12.141097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee8155-ddd9-403a-ab55-278b4180be30 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:12.142620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 575/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 11:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:12.148376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:12.207977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:12.243760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5961-3b64-4377-9404-69bc5b8ce459 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:12.275991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:12.276664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:12.276949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:12.277215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:12.278134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:12.280327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b754f-5ea5-4c06-b9e7-2355988b072c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:12.369825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 563/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:59:12 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:14.601276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeded74-2d17-4fca-aa59-14443835d609 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:14.601827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeded74-2d17-4fca-aa59-14443835d609 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:14.601827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeded74-2d17-4fca-aa59-14443835d609 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:14.603087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 576/1139] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:14.608186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:14.608643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:14.608752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:14.626242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:14.627434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:14.692349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 564/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:14.715265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeded74-2d17-4fca-aa59-14443835d609 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:14.812055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeded74-2d17-4fca-aa59-14443835d609 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:14.840274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:14.845671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:14.846445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:14.846721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:14.846985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:14.859475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:14.864585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:14.865765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:14.866697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 577/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:14.871671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:14.919406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:14.967925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96850228-9c1d-44c6-b264-208e5bcfb320 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:15.000535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:15.001187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:15.001470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:15.001742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:15.002468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:15.002768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:15.004687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:15.012414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 565/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:15.018074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:15.112866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03db9-4c4a-4541-85b0-9607693cbfba None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:15.144509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:15.145383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:15.146176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:15.146444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] PATH_INFO: `/v3/users/95469ca09a8b4b14b5717f95c14ef155` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:15.158844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] RBAC: Authorizing `identity:get_user(user_id=95469ca09a8b4b14b5717f95c14ef155)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:15.160817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:15.162418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 578/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:15 2022] GET /identity/v3/users/95469ca09a8b4b14b5717f95c14ef155 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:15.168030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:15.264020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336bdd-ed59-4890-a86a-9ac1408a5c21 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:15.273855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:15.296159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:15.298829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:15.298829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:15.298829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:15.362694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:15.364743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:15.458431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 566/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:15.464254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:15.513113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:15.562505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781afe-66ab-42d9-8cdb-95ae24773734 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:15.594753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:15.595596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:15.595871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:15.596140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] PATH_INFO: `/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:15.597324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] RBAC: Authorizing `identity:get_project(project_id=fd24e88e11d943ad9ee29b3c7a41d883)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:15.598888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca5796-a008-4ea1-934d-3855435e0109 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:15.600582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 579/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:15 2022] GET /identity/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:15.606542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:15.618345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:15.703838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70350-a219-40c3-a0e6-743128674334 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:15.736827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:15.737486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:15.737750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:15.738023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:15.739437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=fd24e88e11d943ad9ee29b3c7a41d883, user.id=95469ca09a8b4b14b5717f95c14ef155) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:15.739744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:15.741189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8aedc-ba1d-4128-8ef1-0d14e5eb110b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:15.746434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 567/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:15 2022] GET /identity/v3/role_assignments?user.id=95469ca09a8b4b14b5717f95c14ef155&scope.project.id=fd24e88e11d943ad9ee29b3c7a41d883&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:17.904346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dac3-e6aa-4ada-9caf-dca39320429a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:17.904891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dac3-e6aa-4ada-9caf-dca39320429a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:17.904891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87dac3-e6aa-4ada-9caf-dca39320429a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:17.906248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 580/1147] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:17.912053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:17.912504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:17.912606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:17.928754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:17.929905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:17.994436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 568/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:18.016819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87dac3-e6aa-4ada-9caf-dca39320429a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:18.115604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87dac3-e6aa-4ada-9caf-dca39320429a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:18.132389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:18.149039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:18.149814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:18.150133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:18.150403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:18.159970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:18.168659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:18.169769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:18.170820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 581/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:18.176616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:18.179613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:18.272050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2a95-b24c-4e7c-b8e8-665a1d47492c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:18.304294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:18.304939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:18.305216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:18.305760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:18.306483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:18.306782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:18.308155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:18.315842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 569/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:18.322020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:18.417686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d2f-b019-4bc7-97fb-2729fcbf14bd None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:18.448735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:18.449577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:18.449852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:18.450119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] PATH_INFO: `/v3/users/95469ca09a8b4b14b5717f95c14ef155` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:18.451267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] RBAC: Authorizing `identity:get_user(user_id=95469ca09a8b4b14b5717f95c14ef155)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:18.452698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:18.454273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 582/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:18 2022] GET /identity/v3/users/95469ca09a8b4b14b5717f95c14ef155 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:18.460437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:18.524491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:18.558042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a38d1-e4f3-4157-8123-1d9f11910cdf None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:18.590431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:18.591267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:18.591546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:18.591816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] PATH_INFO: `/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:18.592997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=fd24e88e11d943ad9ee29b3c7a41d883)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:18.594414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464630d5-c9fc-42f8-93e3-f0d2ca235bf9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:18.596063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 570/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:18 2022] GET /identity/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:18.601994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:18.645750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:18.696769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b704-8a11-4753-9832-8f622ac37068 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:18.728061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:18.728945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:18.729218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:18.729484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] PATH_INFO: `/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883/users/95469ca09a8b4b14b5717f95c14ef155/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:18.731377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] RBAC: Authorizing `identity:create_grant(project_id=fd24e88e11d943ad9ee29b3c7a41d883, user_id=95469ca09a8b4b14b5717f95c14ef155, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:18.732809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae529-0d17-4607-96a1-7703f9e1f41d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:18.833188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 583/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:59:18 2022] PUT /identity/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883/users/95469ca09a8b4b14b5717f95c14ef155/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:59:21.001490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ae604-687f-4376-b555-978bd4e5d791 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.002048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ae604-687f-4376-b555-978bd4e5d791 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.002048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ae604-687f-4376-b555-978bd4e5d791 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.003401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 571/1154] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:21.009176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.009566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.009721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.026715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:21.027892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:21.092329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 584/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:21.115133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ae604-687f-4376-b555-978bd4e5d791 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:21.213991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ae604-687f-4376-b555-978bd4e5d791 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:21.246451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:21.247215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.247493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.247761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.249560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:21.257831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:21.265292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:21.266394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:59:21.267621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 572/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:21.272365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:21.305919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:21.370114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffd83-df0e-49dc-a424-a793ba7dd0e2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:21.402608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:21.403254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.403530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.403800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.404553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:21.404852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:21.406187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:21.413863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 585/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:21.419604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:21.516766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748ea9b-aadf-446d-80b6-5f6e1abd0b80 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:21.548597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:21.549448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.549731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.550004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] PATH_INFO: `/v3/users/95469ca09a8b4b14b5717f95c14ef155` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.551686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] RBAC: Authorizing `identity:get_user(user_id=95469ca09a8b4b14b5717f95c14ef155)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:21.553134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:21.554719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 573/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/users/95469ca09a8b4b14b5717f95c14ef155 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:21.560581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:21.650037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:21.655443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61920-133c-452e-bcba-22e9ef9e3436 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:21.687427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:21.688045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.688352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.688625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.751597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:21.753029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:21.839944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:21.846001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 586/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:21.852530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:21.911330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:21.949031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ae0c-e302-493f-b90f-296df65f3531 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:21.980977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:21.981804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:21.982084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:21.982355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] PATH_INFO: `/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:21.983505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] RBAC: Authorizing `identity:get_project(project_id=fd24e88e11d943ad9ee29b3c7a41d883)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:21.984951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dbd85-f738-45b5-b7f4-dd125713f164 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:21.986592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 574/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/projects/fd24e88e11d943ad9ee29b3c7a41d883 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:21.992596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:22.087529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81762c59-3856-4b3d-9da8-edb42a5f46e4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:22.119403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:22.119976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:22.120275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:22.120546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:22.121346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=fd24e88e11d943ad9ee29b3c7a41d883, user.id=95469ca09a8b4b14b5717f95c14ef155) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:22.121646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:22.123042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a38f-1185-419a-95d4-6f1f6ca9f7fe None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:22.128600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 587/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:21 2022] GET /identity/v3/role_assignments?user.id=95469ca09a8b4b14b5717f95c14ef155&scope.project.id=fd24e88e11d943ad9ee29b3c7a41d883&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:24.327303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cebb18-ed77-42ef-b5cf-b5802ede83f0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:24.327822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cebb18-ed77-42ef-b5cf-b5802ede83f0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:24.327915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cebb18-ed77-42ef-b5cf-b5802ede83f0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:24.329236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 575/1162] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:24.335029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:24.335424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:24.335582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:24.351853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:24.353052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:24.406754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:24.418055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 588/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:24.440920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cebb18-ed77-42ef-b5cf-b5802ede83f0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:24.540405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cebb18-ed77-42ef-b5cf-b5802ede83f0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:24.567750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:24.573683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:24.574316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:24.574593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:24.574859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:24.638061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:24.639438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:24.732870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 576/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:24.738797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:24.832465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c2e28-f7cb-41c0-95c2-67bc5b04da2a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:24.864370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:24.865140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:24.865413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:24.865676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:24.871976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:24.873414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-f68d092c-00ea-4997-99bb-3d7fdfcd29d6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:24.887682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:24.888938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:24.890006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 589/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 11:59:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:24.895232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:24.923226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:24.988768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3bc9b-48ed-4149-a6f9-346b18ab9a9d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:25.021779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:25.022424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:25.022706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:25.022980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:25.023682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:25.023984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:25.025373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380aa2c-444f-4819-9f03-0e541cb423b9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:25.032254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 577/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 19 11:59:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:59:27.205271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678423-b44e-42c9-bc00-a2f77094775d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:27.205795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678423-b44e-42c9-bc00-a2f77094775d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:27.205795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678423-b44e-42c9-bc00-a2f77094775d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:27.207246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 590/1167] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:27.212356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cae59-1b62-4ddd-b75d-275afe758688 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:27.212776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cae59-1b62-4ddd-b75d-275afe758688 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:27.212908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cae59-1b62-4ddd-b75d-275afe758688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:27.229583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f22cae59-1b62-4ddd-b75d-275afe758688 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:27.230745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f22cae59-1b62-4ddd-b75d-275afe758688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:27.294610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 578/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:27.317744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51678423-b44e-42c9-bc00-a2f77094775d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:27.368075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:27.416429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51678423-b44e-42c9-bc00-a2f77094775d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:27.449306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:27.449950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:27.450230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:27.450502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:27.451236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:27.452613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81f55f-f883-45d0-ad8a-714f31a76c12 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:27.546390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 591/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Thu May 19 11:59:27 2022] POST /identity/v3/domains => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:29.757872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44a1ae-9774-4fd0-8b5f-4510c93a3270 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:29.758410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44a1ae-9774-4fd0-8b5f-4510c93a3270 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:29.758410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44a1ae-9774-4fd0-8b5f-4510c93a3270 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:29.759785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 579/1170] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:29.764854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:29.765285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:29.765397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:29.782111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:29.783285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:29.846355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 592/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:29.870314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44a1ae-9774-4fd0-8b5f-4510c93a3270 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:29.895588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:29.968320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44a1ae-9774-4fd0-8b5f-4510c93a3270 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:30.000380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:30.001218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:30.001491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:30.001758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] PATH_INFO: `/v3/domains/d7cf6fb9f2564467b5e0974f698a574d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:30.012151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7cf6fb9f2564467b5e0974f698a574d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:30.013559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08722658-9c0b-4e96-9df2-0914f8678556 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:30.015144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 580/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 19 11:59:29 2022] GET /identity/v3/domains/d7cf6fb9f2564467b5e0974f698a574d => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:30.021626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:30.061326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:30.116774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d19f35-cf92-4b91-9017-e2cef87cb6a9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:30.148110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:30.148772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:30.149047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:30.149312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:30.150007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:30.151400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f696684-1526-4f5f-836d-611a0647a9b7 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:30.210134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 593/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 11:59:30 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:32.413143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c976-99a8-4fd1-98cb-a7f095997fd1 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.413629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c976-99a8-4fd1-98cb-a7f095997fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.413721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c976-99a8-4fd1-98cb-a7f095997fd1 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.415040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 581/1174] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:32.420122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.420538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.420692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.438298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:32.439463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:32.502901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 594/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:32.527897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c976-99a8-4fd1-98cb-a7f095997fd1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:32.610745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:32.627567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c976-99a8-4fd1-98cb-a7f095997fd1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:32.660163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:32.661038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.661316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.661582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] PATH_INFO: `/v3/domains/d7cf6fb9f2564467b5e0974f698a574d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.662740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7cf6fb9f2564467b5e0974f698a574d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:32.664162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81bd27-981d-4f88-be8b-41ca2ab52bc4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:32.665778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 582/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 19 11:59:32 2022] GET /identity/v3/domains/d7cf6fb9f2564467b5e0974f698a574d => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:32.671410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:32.695321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:32.766922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81b331-7590-4dfb-becb-7d63d78edf85 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:32.799610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:32.800306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.800589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.800859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.801550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:32.802945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b443f-2ec8-4ab2-ad5d-1c0ff316a2e0 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:32.882590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 595/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 11:59:32 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:35.104470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7130292-e8b3-46b2-bf01-b6bf59bb464e None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.105038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7130292-e8b3-46b2-bf01-b6bf59bb464e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.105038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7130292-e8b3-46b2-bf01-b6bf59bb464e None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.106374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 583/1178] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:35.111662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.112030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.112237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.129862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:35.131891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:35.197133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 596/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:35.220213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7130292-e8b3-46b2-bf01-b6bf59bb464e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:35.319454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7130292-e8b3-46b2-bf01-b6bf59bb464e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:35.352492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:35.353268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.353546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.353815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.363491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:35.370915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:35.372025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:59:35.372982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 584/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:35.377952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:35.388214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:35.472861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0a2e-35c3-44fe-952e-ec324c6502a3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:35.504772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:35.505418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.505699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.505961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.506705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:35.507002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:35.508366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:35.515991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 597/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:35.522345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:35.537226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:35.618671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92fc8-08d4-4d05-9c9f-58a9ed4583b4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:35.651059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:35.651894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.652174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.652485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] PATH_INFO: `/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.664926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] RBAC: Authorizing `identity:get_user(user_id=c46222b0a6ba49ef9cd3c0c2f8d8f8de)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:35.666356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:35.667948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 585/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:35.675829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:35.742878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:35.771527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204666f-5a81-4ef4-95ff-9749cbcb42f8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:35.803791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:35.804439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.804717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.804983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.874627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:35.875980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:35.940869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:35.970339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 598/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:59:35.976457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:36.042287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:36.071184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced95a-bd7a-49c3-9bb2-517411e52446 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:36.104078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:36.104945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:36.105514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:36.105514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] PATH_INFO: `/v3/projects/fb936990639c4740b808165c60c616fd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:36.106631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=fb936990639c4740b808165c60c616fd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:36.108037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7979394-cca5-4daa-82bf-78812500d6d6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:36.109723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 586/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/projects/fb936990639c4740b808165c60c616fd => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:36.116263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:36.208824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8fd1b-9975-4acf-9037-df4909bd861b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:36.241717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:36.242347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:36.242623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:36.242893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:36.243699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=fb936990639c4740b808165c60c616fd, user.id=c46222b0a6ba49ef9cd3c0c2f8d8f8de) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:36.244004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:36.245441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238633a-698b-43eb-b2bc-508454f11974 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:36.250627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 599/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:36 2022] GET /identity/v3/role_assignments?user.id=c46222b0a6ba49ef9cd3c0c2f8d8f8de&scope.project.id=fb936990639c4740b808165c60c616fd&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:38.434832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f701-36a2-4934-8a8f-3bc698bb0cab None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:38.435338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f701-36a2-4934-8a8f-3bc698bb0cab None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:38.435430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f701-36a2-4934-8a8f-3bc698bb0cab None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:38.436756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 587/1186] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:38.442363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:38.442725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:38.442924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:38.459679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:38.460894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:38.486273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:38.525821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 600/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:38.548402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f701-36a2-4934-8a8f-3bc698bb0cab None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:38.647532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f701-36a2-4934-8a8f-3bc698bb0cab None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:38.681241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:38.682012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:38.682292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:38.682565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:38.689104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:38.692897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:38.700486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:38.701592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 11:59:38.702780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 588/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:38.708051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:38.801739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80da66-c23e-4923-8832-bfbd8f1209db None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:38.833975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:38.834946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:38.835222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:38.835490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:38.836233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:38.836535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:38.837884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:38.845576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 601/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:38.851805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:38.948119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2700ed5-be6f-4823-877d-09192805022c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:38.979693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:38.980585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:38.980862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:38.981130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] PATH_INFO: `/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:38.982277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] RBAC: Authorizing `identity:get_user(user_id=c46222b0a6ba49ef9cd3c0c2f8d8f8de)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:38.983702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:38.985315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 589/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:38 2022] GET /identity/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:38.991467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:39.017773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:39.085966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34ce28-d98e-4866-9104-f4b34139e3a8 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:39.118040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:39.118875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:39.119177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:39.119448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] PATH_INFO: `/v3/projects/fb936990639c4740b808165c60c616fd` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:39.120630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] RBAC: Authorizing `identity:get_project(project_id=fb936990639c4740b808165c60c616fd)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:39.122032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fdbf7-1fed-43ce-b24e-1a25db316f22 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:39.123667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 602/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:38 2022] GET /identity/v3/projects/fb936990639c4740b808165c60c616fd => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:39.129460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:39.192695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:39.225296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65f4a-c844-4851-8e9c-e4d1a8254ddc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:39.257350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:39.258210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:39.258484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:39.258750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] PATH_INFO: `/v3/projects/fb936990639c4740b808165c60c616fd/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:39.260655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb936990639c4740b808165c60c616fd, user_id=c46222b0a6ba49ef9cd3c0c2f8d8f8de, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:39.262059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8782f9-99dc-49eb-92be-0a763b078ef6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:39.375907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 590/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 11:59:39 2022] PUT /identity/v3/projects/fb936990639c4740b808165c60c616fd/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:59:41.536322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959868-dd94-490b-9aa6-3cbaa3339b89 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:41.536860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959868-dd94-490b-9aa6-3cbaa3339b89 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:41.536860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959868-dd94-490b-9aa6-3cbaa3339b89 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:41.538216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 603/1193] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 11:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:41.543501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:41.543906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:41.544053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:41.561182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:41.562350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:41.626119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 591/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 11:59:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:41.648906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959868-dd94-490b-9aa6-3cbaa3339b89 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:41.741236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:41.748086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959868-dd94-490b-9aa6-3cbaa3339b89 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:41.779793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:41.780624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:41.781088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:41.781569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:41.792141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:41.799672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:41.800823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 11:59:41.801897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 604/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 11:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:41.807040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:41.860457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:41.901937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209159f5-6ce7-411d-90bb-1fcc011afafa None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:41.934870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:41.935515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:41.935793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:41.936065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:41.936816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:41.937118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:41.938513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:41.946317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 592/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 11:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:41.951952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:42.049541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e1ad-5122-44b7-b2ca-263dc0c7f601 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:42.082195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:42.083057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.083339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.083609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] PATH_INFO: `/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.084798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] RBAC: Authorizing `identity:get_user(user_id=c46222b0a6ba49ef9cd3c0c2f8d8f8de)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:42.086213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:42.087786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 605/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 19 11:59:41 2022] GET /identity/v3/users/c46222b0a6ba49ef9cd3c0c2f8d8f8de => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:42.093374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:42.188453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb8559-2ef2-4866-b948-626eb9e69268 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:42.204098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:42.219751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:42.220406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.220685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.220954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.287065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:42.288597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:42.386793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 593/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 11:59:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:42.392657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:42.416549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:42.488743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db34b5-88be-4a0c-9c70-4a05954bb671 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:42.520371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:42.521207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.521485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.521756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] PATH_INFO: `/v3/projects/fb936990639c4740b808165c60c616fd` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.522910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] RBAC: Authorizing `identity:get_project(project_id=fb936990639c4740b808165c60c616fd)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:42.524343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f9ec6-e3b7-47ff-b7a1-8dde6edae92a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:42.525993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 606/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 19 11:59:42 2022] GET /identity/v3/projects/fb936990639c4740b808165c60c616fd => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:42.531901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:42.549288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:42.625916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a14e-1f30-4285-a627-34c2c47a6048 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:42.659122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:42.659767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.660043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.660343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.661143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=fb936990639c4740b808165c60c616fd, user.id=c46222b0a6ba49ef9cd3c0c2f8d8f8de) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:42.661442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:42.662846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ffa3-05cc-4590-a8c2-e3fcb47c21c1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:42.668400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 594/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 11:59:42 2022] GET /identity/v3/role_assignments?user.id=c46222b0a6ba49ef9cd3c0c2f8d8f8de&scope.project.id=fb936990639c4740b808165c60c616fd&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:59:52.516393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=55 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:52.665921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=59 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:04.522535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e3a0-ea17-40f5-bf0e-5608332de98e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:04.523124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e3a0-ea17-40f5-bf0e-5608332de98e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:04.523124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e3a0-ea17-40f5-bf0e-5608332de98e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:04.524458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 607/1201] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:04.529770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:04.530186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:04.530314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:04.547323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:04.549109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:04.615951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 595/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:04.640387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97e3a0-ea17-40f5-bf0e-5608332de98e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:04.739862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97e3a0-ea17-40f5-bf0e-5608332de98e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:04.771414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:04.772351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:04.772470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:04.772750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:04.783344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:04.784908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:04.801940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:04.803095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:04.804092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:04.804092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:04.804092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:04.804092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:04.804092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 608/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:04.809582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:04.904454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8099e-e75f-41e5-8b95-2084f9abe045 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:04.932344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:04.938070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:04.938797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:04.939692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:04.939966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:04.940706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:04.941004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:04.942357 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb4ba8-3569-4fc6-867a-e5213c83dbfb None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:04.953226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 596/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:04.959294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:05.011118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:05.056217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830e79-69e3-4a8b-bb45-43c927aa484b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:05.089669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:05.092489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:05.092489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:05.092489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:05.092489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:05.093149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea668ee-6200-44b4-9ec3-fbbf22b26b61 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:05.256893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 609/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 19 12:01:04 2022] POST /identity/v3/users => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:01:07.468966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6446d-1a89-4841-a7fd-9ffb45d055fc None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:07.469550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6446d-1a89-4841-a7fd-9ffb45d055fc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:07.469550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6446d-1a89-4841-a7fd-9ffb45d055fc None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:07.471529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 597/1206] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:07.476942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:07.477370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:07.477497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:07.494089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:07.495254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:07.560178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 610/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:07.584586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6446d-1a89-4841-a7fd-9ffb45d055fc None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:07.683274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6446d-1a89-4841-a7fd-9ffb45d055fc None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:07.716521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:07.717337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:07.717605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:07.717872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:07.728051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:07.735910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:07.737158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:07.738213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 598/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 12:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:07.743035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:07.781391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:07.838643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4be534-3121-4e7c-9aa3-8d0b350efa71 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:07.870942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:07.871608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:07.871889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:07.872188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:07.872946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:07.873249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:07.874615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:07.882924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 611/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 12:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:07.888814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:07.938187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:07.987461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e52c70-cb78-49d4-8358-a0932709c393 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.019824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.020659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.020937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.021205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.031194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.032694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:08.050638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:08.051792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:08.052939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:08.052939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:08.052939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:08.052939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:08.052939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 599/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:08.057614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:08.152248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:08.155139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301750-cda8-4fd7-ad30-47ae99df4b28 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.187467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.188119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.188479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.188702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.190000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:08.190299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.191650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.203336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 612/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:08.209107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:08.307027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d567c7c-dc5b-4384-94fa-214ce3d913e0 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.308795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:08.341325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.342121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.342400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.342672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.350095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.351527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:08.366517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:08.372902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:08.373905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 600/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:08.374530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:08.470949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce86a8-4c13-4fc4-be63-f93ca7bd4472 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.504161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.504843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.505121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.505393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.506207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:08.506535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.507941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.524865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 613/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:08.530602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:08.628476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc887a13-cd20-4bfe-9dfd-4e5fd8d25558 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.661650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.662290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.662566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.662834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.692907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:08.730040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.731433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.827911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 601/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 12:01:08.833751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:08.852083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:08.929352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545c08b-dd2b-4dbc-b7be-32c4d729c709 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:08.963618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:08.964427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:08.964711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:08.964987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:08.975431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:08.976885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:08.996223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:08.997292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:08.998433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:08.998433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:08.998433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:08.998433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:08.998433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 614/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:09.000786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:09.060296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:09.098075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af665dda-b6a3-43f6-a5e5-41083e004482 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:09.130812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:09.131461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.131739 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.132010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.132743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:09.133043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:09.134415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:09.146532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 602/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:09.152122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:09.219712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:09.249690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e011-7c85-414a-ad2c-a982b8788b14 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:09.281474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:09.282251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.282528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.283305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.290262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:09.291841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:09.306130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:09.307254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:09.308399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 615/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:09.313372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:09.410649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1869c3a-5057-4af1-a329-a1f947a345d4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:09.432546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:09.444067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:09.444750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.445031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.445303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.446076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:09.446378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:09.447810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5833ca-6fad-45a3-a556-e8fd46a1fec3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:09.459640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 603/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:09.465649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:09.561297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ad864-023b-49c5-be41-81c701c34f8f None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:09.588073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:09.593677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:09.594354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.595163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.595163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.596309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=56883af2bfba4a12b2642987506a187e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:09.596647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:09.598056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1617e7c-b6c7-490e-9339-3ca2d89f732b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:09.603394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 616/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 12:01:09 2022] GET /identity/v3/role_assignments?user.id=56883af2bfba4a12b2642987506a187e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:11.794316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e63e6-51e7-45ba-af74-6e4c85c40593 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:11.794873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e63e6-51e7-45ba-af74-6e4c85c40593 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:11.794873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e63e6-51e7-45ba-af74-6e4c85c40593 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:11.796259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 604/1220] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:11.802048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:11.802468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:11.802587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:11.819815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:11.821027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:11.886722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 617/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:11.910142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e63e6-51e7-45ba-af74-6e4c85c40593 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.009139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e63e6-51e7-45ba-af74-6e4c85c40593 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.042969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.043785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.044048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.044403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.054771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:12.062887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:12.067896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:12.068924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 605/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 12:01:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:12.070839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.168246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434aa4f-c319-40d5-9262-c01697afbbb1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.191153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:12.201572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.202226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.202507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.206086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.206086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] RBAC: Adding query filter params (name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:12.206086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:12.206086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:12.213541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 618/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:12.219482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.262836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:12.318622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f1d1-50e6-44b7-8b9e-62413ce4da5a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.351510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.352407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.352689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.352961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.363798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:12.365279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:12.382130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:12.383212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:12.384373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:12.384373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:12.384373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:12.384373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:12.384373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 606/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:12.389090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.489955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a457-b7d2-4d9c-b18d-3492b243548b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.522837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.523489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.523766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.524040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.524775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:12.525078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:12.526426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:12.537798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 619/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:12.543461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.636779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:12.643229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccd568-a57e-465b-af85-4441a3252536 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.676184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.676989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.677266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.677535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.684514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:12.686001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:12.700670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:12.702546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:12.704821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 607/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:12.709135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.755809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:12.806611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a77-fbb7-4cd9-9cc5-57b67cfd1716 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.839137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.839793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.840066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.840363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:12.841169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:12.841466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:12.842924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:12.859609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 620/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:12.865378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:12.961334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ce02-8c68-450e-bd7d-15ef3892b129 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:12.993128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:12.993891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:12.994167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:12.994431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.004587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:13.006017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:13.023243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:13.024368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:13.025441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:13.025441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:13.025441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:13.025441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:13.025441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 608/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:13.030123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:13.126243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce426ab-b90a-4415-ba4d-eea746ff19ce None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:13.129049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:13.158267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:13.158922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.159200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.159469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.160176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:13.160513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:13.161869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:13.172531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 621/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:01:13.178642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:13.187421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:13.274304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c4747-8797-419b-8bb0-6571b80bbca3 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:13.307408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:13.308183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.308513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.309065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.315627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:13.317129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:13.331638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:13.332790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:13.334012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 609/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:13.339155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:13.437465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e7f9-1754-409e-a741-14ee06a8ea2a None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:13.469324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:13.469956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.470845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.471089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.471850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:13.472149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:13.473576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63081fa-bf4b-4688-83d4-14e74ba07bb9 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:13.484984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 622/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:13.490929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:13.557794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:13.590546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa9b3-746e-494e-8af5-2edc3cf2ef2b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:13.623369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:13.624260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.624544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.624819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/56883af2bfba4a12b2642987506a187e/roles/e4a1516ad86c47d9b285a35058dc36c3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.638889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=56883af2bfba4a12b2642987506a187e, role_id=e4a1516ad86c47d9b285a35058dc36c3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:13.640380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872abdd8-fb71-4691-a4cb-963354db7ddc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:13.799922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 610/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 12:01:13 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/56883af2bfba4a12b2642987506a187e/roles/e4a1516ad86c47d9b285a35058dc36c3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:01:15.983208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b12dd-7a5f-42c4-8be9-ad3a7843d6f6 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:15.983741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b12dd-7a5f-42c4-8be9-ad3a7843d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:15.983741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b12dd-7a5f-42c4-8be9-ad3a7843d6f6 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:15.985127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 623/1233] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:15.990948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:15.997100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:15.997100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.008238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:16.009410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:16.073615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 611/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:16.097083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b12dd-7a5f-42c4-8be9-ad3a7843d6f6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.121674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:16.195544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b12dd-7a5f-42c4-8be9-ad3a7843d6f6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:16.227707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294814e-16e3-4593-aefd-783411949568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:16.228513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294814e-16e3-4593-aefd-783411949568 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:16.228793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294814e-16e3-4593-aefd-783411949568 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:16.229062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294814e-16e3-4593-aefd-783411949568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.239345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294814e-16e3-4593-aefd-783411949568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e294814e-16e3-4593-aefd-783411949568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:16.246897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:16.247888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:16.253892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 624/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 12:01:16.255196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.300333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:16.351276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c9298-0fe9-4193-b1ec-de93785cfe9e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:16.384272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:16.384932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:16.385210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:16.385482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.386215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:16.386514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:16.387886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:16.396119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 612/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:16.402388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294814e-16e3-4593-aefd-783411949568 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.486087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:16.501048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294814e-16e3-4593-aefd-783411949568 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:16.533546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:16.534321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:16.534601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:16.534868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.544982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:16.554654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:16.563060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:16.564717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:16.565743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:16.565743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:16.565743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:16.565743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:16.565743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 625/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 12:01:16.570516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.667370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c6590-f875-4b43-a334-5eec9e6fa0bf None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:16.676920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:16.700568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:16.703538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:16.703538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:16.703538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.703538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:16.703538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:16.704058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:16.715454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 613/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:16.721568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.819892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4780-43cf-45d7-a917-5e5784fa2cd4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:16.853088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:16.853870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:16.854148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:16.854420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:16.857040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:16.861817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:16.863231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:16.877181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:16.878386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:16.879563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 626/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:16.884169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:16.981975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d988-6699-4628-b612-41e0c3458ed6 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.014987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.015638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.015917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.016190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.017036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:17.017338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.018754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.035117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 614/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:17.040819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:17.138355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a309ba-ab8f-4b72-935a-8a271ed6bc89 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.170441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.171107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.171397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.171661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.230669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:17.237526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.238959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.332272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 627/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 12:01:17.338322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:17.365063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:17.436998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53b97-f553-40b0-af75-29e27cc4e863 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.470989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.471771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.472093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.472402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.482409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.483923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:17.501587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:17.502682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:17.503869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:17.503869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:17.503869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:17.503869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:17.503869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 615/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:17.508535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:17.598571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:17.604004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533104a-63d4-4d78-ac8d-f52178cb8237 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.635370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.636013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.636318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.636586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.637289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:17.637597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.638928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.649968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 628/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:17.655719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:17.733068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:17.753064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd93bd0-3cf4-48d2-9950-b90ee42e19c9 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.787707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.788513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.788787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.789053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.795431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.796897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:17.810408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:17.811523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:17.812610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 616/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:17.817571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:17.914176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427cfc-7b09-4285-b504-068d720a9046 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:17.947207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:17.947852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:17.948130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:17.948431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:17.949197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:17.949500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:17.950948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97449b4d-e2e9-49f7-9683-695d55c2850e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:17.963040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 629/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:17.969130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:18.066600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b45ac3-e6c2-44d2-8277-aa03814a66dc None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:18.099673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:18.100343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:18.100624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:18.100896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:18.101699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] RBAC: Adding query filter params (role.id=e4a1516ad86c47d9b285a35058dc36c3, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=56883af2bfba4a12b2642987506a187e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:18.102004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:18.103419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a4681-6514-4162-9093-2f0b373bc6d4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:18.109118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 617/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 12:01:17 2022] GET /identity/v3/role_assignments?user.id=56883af2bfba4a12b2642987506a187e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=e4a1516ad86c47d9b285a35058dc36c3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:20.353172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ec30c-06d6-496a-91f2-7edb25c12238 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:20.353634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ec30c-06d6-496a-91f2-7edb25c12238 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:20.353743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ec30c-06d6-496a-91f2-7edb25c12238 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:20.355126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 630/1247] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:20.360340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:20.366191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:20.366191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:20.366650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:20.378918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:20.380071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:20.445134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 618/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:20.469256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ec30c-06d6-496a-91f2-7edb25c12238 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:20.486932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:20.569456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ec30c-06d6-496a-91f2-7edb25c12238 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:20.606923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:20.606923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:20.606923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:20.606923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:20.613875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:20.621319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:20.622433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:20.623686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 631/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 12:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:20.629191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:20.725023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c533d1-f90d-4cbd-b1c7-5d75d23e9fed None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:20.752846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:20.757542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:20.764437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:20.769274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 619/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 12:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:20.775068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:20.851698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:20.873939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12568487-a2c8-46a7-b784-f1b16d0fc73c None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:20.905497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:20.906266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:20.906546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:20.906812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:20.916826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:20.918240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:20.937947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:20.939780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:20.941120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:20.941120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:20.941120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:20.941120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:20.941120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 632/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:20.945525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.041834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665534d-77dd-46f7-82ff-5a0043b499b8 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:21.074209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:21.074852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:21.075132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:21.075405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:21.076104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:21.076436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:21.077799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:21.089021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 620/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:21.094593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.193230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15873-cf67-4304-bc3d-550e2be64bf3 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:21.217993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:21.226031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:21.226820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:21.227092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:21.227362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:21.234696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:21.236775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:21.250598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:21.252104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:21.253403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 633/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:21.258037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.311793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:21.354670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b007-5bbe-4916-857c-6fe77cda846a None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:21.387909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:21.397416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:21.409253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 621/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:21.414902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.512554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb438b-799d-4666-9525-37b724b50799 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:21.544976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:21.545630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:21.545910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:21.546177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:21.600446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:21.612338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:21.613780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:21.707151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 634/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 12:01:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 12:01:21.713032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.809653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81751894-835d-40a4-a0f9-e5a641e3699c None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:21.822698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:21.842457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:21.843229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:21.843504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:21.843770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:21.853697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:21.855123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:21.872216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:21.873249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:21.874213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:21.874213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:21.874213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:21.874213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:21.874213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 622/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:21.879108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:21.963248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:21.975833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2767b7-39ad-44fe-a56f-ee1148648501 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:22.009965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:22.010641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.010921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.011190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.011900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:22.012224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:22.013612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:22.025570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 635/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:22.031335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:22.130322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0ed2-6b0e-4c80-a280-a22ff2a0276e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:22.163762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:22.164557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.164833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.165100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.171433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:22.172891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:22.186601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:22.187667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:22.188993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 623/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:22.193675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:22.290710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd7b3-7865-40a1-8d30-43129b770500 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:22.324347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:22.325020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.325297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.325565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.326328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:22.326626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:22.328098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf266d-b22f-4d82-9dc4-1ddcec78292a None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:22.341328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 636/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:22.347917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:22.372758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:22.446213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9561-5800-499e-8575-75c5d33fa448 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:22.479607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:22.480274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.480562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.480836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.481644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=56883af2bfba4a12b2642987506a187e) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:22.481948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:22.483389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c101f-6f48-4d95-a465-3b63743039d5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:22.488773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 624/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 12:01:22 2022] GET /identity/v3/role_assignments?user.id=56883af2bfba4a12b2642987506a187e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:24.656674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95469bb-a634-48df-ac4e-4465189a12a9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.657169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95469bb-a634-48df-ac4e-4465189a12a9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.657169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95469bb-a634-48df-ac4e-4465189a12a9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.658522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 637/1261] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:24.663684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229990-096a-479c-960f-7480416e31cd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.664105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229990-096a-479c-960f-7480416e31cd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.664270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229990-096a-479c-960f-7480416e31cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.681501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c6229990-096a-479c-960f-7480416e31cd None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:24.682675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c6229990-096a-479c-960f-7480416e31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:24.747351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 625/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:24.769246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95469bb-a634-48df-ac4e-4465189a12a9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:24.779822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:24.867682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95469bb-a634-48df-ac4e-4465189a12a9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:24.900850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:24.901663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.901940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.902221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.911930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:24.919525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:24.920646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:24.921824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:24.924364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 638/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 12:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:24.927562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6229990-096a-479c-960f-7480416e31cd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:24.946324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:25.024808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6229990-096a-479c-960f-7480416e31cd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.058845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.059789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.060068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.060376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.061128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:25.061427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.062788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.070580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 626/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 12:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:25.076474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.143141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:25.176521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fe0cd-8295-463e-b910-99f4f8e0d199 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.210748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.211529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.211809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.212103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.223339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.224803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:25.241760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:25.242814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:25.243882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:25.243882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:25.243882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:25.243882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:25.243882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 639/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:25.248814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.329277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:25.347360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcf2d2-76f5-4c1c-8881-972764d7c91d None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.380084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.380763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.381868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.381868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.382063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:25.382273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.383631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.394368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 627/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:25.400125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.497719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4319-3fe7-41d5-96eb-662eb9263e11 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.516744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:25.530083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.530865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.531149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.531420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.539121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.540575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:25.554996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:25.556086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:25.557438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 640/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 12:01:25.562197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.659894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9aff-5ac0-480e-ba22-eb965696ef20 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.692211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.692881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.693159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.693431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.694294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:25.694594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.696039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.705403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:25.713023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 628/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:25.718614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.816345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be125c34-8e0b-4a62-9018-d16c66cf4687 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:25.849054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:25.855623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:25.855623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:25.855623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:25.861155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:25.862575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:25.879759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:25.880954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:25.882066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:25.882066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:25.882066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:25.882066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:25.882066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 641/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:25.886581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:25.984539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2650f-dcf3-46f3-bf03-a8100c4d9e04 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:26.022180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:26.022835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:26.023115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:26.023390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:26.024096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:26.024429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:26.025797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:26.036789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 629/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:26.042374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:26.073944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:26.140012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d874fd1-a5de-45a9-be5d-88428033abed None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:26.172673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:26.173972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:26.174249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:26.174517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:26.181114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:26.182525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:26.197121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:26.198182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:26.199428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 642/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:26.204193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:26.260952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:26.301501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d06cf8-1448-431c-9794-6c1cee766726 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:26.333772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:26.334367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:26.334649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:26.334972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:26.335748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:26.336056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:26.337516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0a18f-a83f-48aa-9c45-36d838a15525 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:26.350624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 630/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:26.356564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:26.445344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:26.453821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28302-3681-4a16-b3b6-f6cba7deaaee None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:26.486106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:26.486962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:26.487236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:26.487501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] PATH_INFO: `/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/56883af2bfba4a12b2642987506a187e/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:26.489451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] RBAC: Authorizing `identity:create_grant(project_id=46296c78ea9d4d13ba0d84ceca2fc9a1, user_id=56883af2bfba4a12b2642987506a187e, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:26.490854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68db5b5-f08f-4789-a3e0-0164408193bf None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:26.602410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 643/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 19 12:01:26 2022] PUT /identity/v3/projects/46296c78ea9d4d13ba0d84ceca2fc9a1/users/56883af2bfba4a12b2642987506a187e/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:01:28.782013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a081a-ac92-46a7-9d49-652691716c06 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:28.783074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a081a-ac92-46a7-9d49-652691716c06 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:28.783074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a081a-ac92-46a7-9d49-652691716c06 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:28.784456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 631/1274] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:28.789494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:28.789887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:28.790042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:28.806508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:28.807659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:28.873391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 644/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:28.897394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a081a-ac92-46a7-9d49-652691716c06 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:28.998202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a081a-ac92-46a7-9d49-652691716c06 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.015108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.031874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.033337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.033560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.033829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.043668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 12:01:29.051238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:29.052407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:29.053315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 632/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 19 12:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:29.058336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.137764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.155127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698768-f692-4a91-a41f-2e6f2c837af4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.187352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643532-3674-430a-a072-700d012202e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.187999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643532-3674-430a-a072-700d012202e4 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.188308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643532-3674-430a-a072-700d012202e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.188601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643532-3674-430a-a072-700d012202e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.189331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643532-3674-430a-a072-700d012202e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:29.189627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643532-3674-430a-a072-700d012202e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.191010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643532-3674-430a-a072-700d012202e4 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.198827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 645/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:29.204787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.302589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18083-5ae3-435d-9e96-64a3d7b7143b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.335331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.336140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.336451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.336705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.347854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.349355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:29.366553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:29.367645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:29.368689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:29.368689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:29.368689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:29.368689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:29.368689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 633/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:29.373439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643532-3674-430a-a072-700d012202e4 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.471690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643532-3674-430a-a072-700d012202e4 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.503853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.504534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.504813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.505084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.505787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:29.506087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.507462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.519180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 646/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:29.524993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.556172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.624354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80070666-c954-4f53-b57e-3c8efa551c4b None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.658290 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.659136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.659418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.659687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.666580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.668027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 12:01:29.683163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:29.692877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:29.694030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 634/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:29.694664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.694911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.785766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8b578-47f3-408f-ad87-fc1711bc3691 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.819255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.819843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.820108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.820404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.821261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:29.821555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.822958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.839995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 647/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:29.845765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.935477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.945624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfacae1-546d-4742-bb6e-3cce118467a5 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.978697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.979331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.979613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.979887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.046617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.048669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.133936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:30.144003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 635/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 12:01:30.149776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:30.209212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:30.246565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed1820-5dfd-4dca-930f-46f0037c531b None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:30.278911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:30.279695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:30.279975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:30.280272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.290314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.292324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 12:01:30.309329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:30.310389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:30.311384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 12:01:30.311384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 12:01:30.311384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 12:01:30.311384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:30.311384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 648/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:30.316455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:30.415389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4eb4-d894-49cb-8fc5-f016f667e75e None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:30.447998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:30.448672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:30.448951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:30.449222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.449930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:30.450229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.451590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.462932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 636/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 19 12:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:01:30.468641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:30.566457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d198c-4062-49d1-b92f-e72a46cf7d41 None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:30.580133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:30.599133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:30.599906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:30.600183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:30.600481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.606821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.608258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 12:01:30.622407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application with Lock( May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:30.623367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: ERROR keystone.server.flask.application May 19 12:01:30.624371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 649/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 19 12:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:30.630091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:30.679237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:30.726689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f08273-ed0b-453f-af93-41d814c14842 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:30.759050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:30.759693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:30.759970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:30.760263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.761031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:30.761330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.762838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283a02-1a98-41b0-b8f0-ad1a9f266e75 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.775214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 637/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 19 12:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:01:30.781337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:30.879065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7708cbc-c379-43eb-88c5-62b9dfec3b9e None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:30.912172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:30.912842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:30.913115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:30.913380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:30.914189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] RBAC: Adding query filter params (role.id=dca1ff9766074e53aabc5609addb3b37, scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1, user.id=56883af2bfba4a12b2642987506a187e) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:30.914493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:30.915888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1d9e-8adc-48c2-ab64-75c871f3c39d None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:30.921576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 650/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 19 12:01:30 2022] GET /identity/v3/role_assignments?user.id=56883af2bfba4a12b2642987506a187e&scope.project.id=46296c78ea9d4d13ba0d84ceca2fc9a1&role.id=dca1ff9766074e53aabc5609addb3b37 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:33.150384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30888e1-c01b-45f0-b0d2-68dfc43d9ef5 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:33.150918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30888e1-c01b-45f0-b0d2-68dfc43d9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:33.150918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30888e1-c01b-45f0-b0d2-68dfc43d9ef5 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:33.152430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 638/1288] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:33.157769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:33.158206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:33.158314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:33.174378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:33.175569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:33.206287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:33.240978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 651/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 12:01:33.262975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30888e1-c01b-45f0-b0d2-68dfc43d9ef5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:33.363335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30888e1-c01b-45f0-b0d2-68dfc43d9ef5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:33.373666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:33.399272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:33.400091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:33.400524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:33.400746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:33.401387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:33.402760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:33.414576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:33.417137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:33.418104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 639/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 12:01:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:33.421759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:33.517505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d24b1-6575-4628-801e-39b8648d9a27 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:33.551283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:33.551942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:33.552252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:33.552525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:33.553249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:33.553550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:33.554906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36058c2-991e-4456-82ff-b0b7af9411aa None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:33.560042 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 652/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 19 12:01:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:33.566303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:33.663574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f68b5-53e5-439d-8c00-df2880d84909 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:33.696655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:33.697309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:33.697590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:33.697863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] PATH_INFO: `/v3/services` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:33.698556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:33.698862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:33.700244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802488a7-9251-4bc6-8245-12fd5f1d5298 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:33.704620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 640/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 19 12:01:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:35.905703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9faf1-373c-4539-8634-62dbbefcfcc6 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:35.906230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9faf1-373c-4539-8634-62dbbefcfcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:35.906230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9faf1-373c-4539-8634-62dbbefcfcc6 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:35.907707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 653/1293] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:35.913049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f31c-acae-40d0-94b1-89ff10c2b21f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:35.913458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f31c-acae-40d0-94b1-89ff10c2b21f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:35.913598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6f31c-acae-40d0-94b1-89ff10c2b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:35.930530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a1f6f31c-acae-40d0-94b1-89ff10c2b21f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:35.931696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a1f6f31c-acae-40d0-94b1-89ff10c2b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:35.961487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:35.998927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 641/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:36.021215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9faf1-373c-4539-8634-62dbbefcfcc6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:36.052600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:36.120932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9faf1-373c-4539-8634-62dbbefcfcc6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:36.154491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:36.155132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:36.155407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:36.155673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:36.156460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:36.157753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fa95d-6eae-4539-a5c5-6577f0cdd9d6 None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:36.257304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 654/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 19 12:01:36 2022] POST /identity/v3/services => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:01:38.469827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bec72-36f9-4168-8827-249cd0cf3701 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:38.470369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bec72-36f9-4168-8827-249cd0cf3701 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:38.470485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bec72-36f9-4168-8827-249cd0cf3701 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:38.471811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 642/1296] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:38.476982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:38.477400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:38.477537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:38.493716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:38.494876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:38.566334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 655/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:38.589296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bec72-36f9-4168-8827-249cd0cf3701 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:38.689154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bec72-36f9-4168-8827-249cd0cf3701 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:38.722181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:38.722952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:38.723226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:38.723492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:38.724126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:38.725517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:38.737579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:38.738608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:38.739583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 643/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 12:01:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:38.744917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:38.763114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:38.841109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2210d4b-54e7-4c79-b5ce-a64865f97e0e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:38.874097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:38.874748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:38.875032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:38.875303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:38.876612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:38.876915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:38.878280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:38.883203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 656/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 19 12:01:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:38.889196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:38.919716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:38.990448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fd29-b53c-46ba-92d1-4b0b54f01d7f None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:39.023039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:39.023685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:39.023963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:39.024259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:39.025062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] RBAC: Adding query filter params (interface=public, service_id=e669f2b2e7e2420ebbf1203a01ff67c4, region_id=RegionOne) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:39.025368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:39.026835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2d02-7eba-4c1a-bce7-5f93ad35941e None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:39.031673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 644/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 19 12:01:38 2022] GET /identity/v3/endpoints?service_id=e669f2b2e7e2420ebbf1203a01ff67c4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:39.037830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:39.122929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:39.141848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71589e-2f33-451c-ba51-ee79663919db None admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:39.177780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:39.178460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:39.178737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:39.179007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:39.179695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:39.181113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6413a-6fe7-4332-ba00-07fcbc658dfd None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:39.190493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 657/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 19 12:01:39 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:01:41.391366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a82c-3633-4382-a12b-c2a73c15ce42 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:41.392598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a82c-3633-4382-a12b-c2a73c15ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:41.392598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a82c-3633-4382-a12b-c2a73c15ce42 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:41.393870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 645/1302] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:41.399126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:41.399536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:41.399753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:41.416313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:41.420720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:41.483595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 658/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:01:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 12:01:41.506596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180a82c-3633-4382-a12b-c2a73c15ce42 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:41.601920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:41.609042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180a82c-3633-4382-a12b-c2a73c15ce42 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:41.642376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:41.643153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:41.643430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:41.643702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:41.644397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:41.645760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:01:41.657183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:01:41.658355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application with Lock( May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self._enter() May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application return self.creator() May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application created_value = creator( May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: ERROR keystone.server.flask.application May 19 12:01:41.659540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 646/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 19 12:01:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 12:01:41.667627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:41.738240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:41.759746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d14d37-4cbe-427d-98e9-e33fb2e0553e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:41.794515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:41.795160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:41.795436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:41.795703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] PATH_INFO: `/v3/services` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:41.796409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:41.796708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:41.798579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed933b-31b1-4bbb-9ab5-37c41e44b3dc None admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:41.803482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 659/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 19 12:01:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:41.809126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:41.906129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3169d3b-d733-41d1-b162-9eba5a21c8c4 None admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:41.939469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:41.940145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:41.940444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:41.945087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:41.945087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:41.945087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4e03-05c7-434c-9411-93fe883505f1 None admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:42.016475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 647/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 19 12:01:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:01:51.810940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=30 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:52.011800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:54.464456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff95-ffc8-4c70-be68-7b6b90195316 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.465392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff95-ffc8-4c70-be68-7b6b90195316 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.465836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff95-ffc8-4c70-be68-7b6b90195316 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.472707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcef02-f8cc-4328-9bea-c93af3126f12 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.473499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcef02-f8cc-4328-9bea-c93af3126f12 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.473931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcef02-f8cc-4328-9bea-c93af3126f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.476476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 660/1307] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:09:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:54.549574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-51bcef02-f8cc-4328-9bea-c93af3126f12 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:54.550788 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-51bcef02-f8cc-4328-9bea-c93af3126f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.655267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 648/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:54.723323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.723684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.723868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.725562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 661/1309] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 19 12:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:54.731892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72dd1-3dd5-4981-9f4b-3f4f9cd26f57 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.732381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72dd1-3dd5-4981-9f4b-3f4f9cd26f57 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.732863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72dd1-3dd5-4981-9f4b-3f4f9cd26f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.842142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-83f72dd1-3dd5-4981-9f4b-3f4f9cd26f57 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:54.843381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-83f72dd1-3dd5-4981-9f4b-3f4f9cd26f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.865748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:54.927478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 649/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 19 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:54.939049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.945593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.076949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac66f4-8f99-4a43-a3ac-b27292d62250 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:55.156962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:55.157614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:55.158397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:55.158678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:55.160382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.216369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:55.274216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:55.275685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8746-a846-4fa5-8ebd-df927bfb0c33 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:55.296572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 662/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:57.804658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d409ff-daa2-489b-801a-918850b06d84 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.805042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d409ff-daa2-489b-801a-918850b06d84 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.805472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d409ff-daa2-489b-801a-918850b06d84 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.807286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 650/1312] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:57.812784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c44b-ddc2-47c7-84c3-63421b5cd64c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.817721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c44b-ddc2-47c7-84c3-63421b5cd64c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.817721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c44b-ddc2-47c7-84c3-63421b5cd64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.896877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b331c44b-ddc2-47c7-84c3-63421b5cd64c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:57.898008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b331c44b-ddc2-47c7-84c3-63421b5cd64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:57.995928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 663/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:58.049677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.050052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.050393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.051866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 651/1314] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 19 12:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:58.057946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332121-6829-49c8-93c2-57240a461639 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.058327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332121-6829-49c8-93c2-57240a461639 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.058686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332121-6829-49c8-93c2-57240a461639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.069324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:58.136614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-83332121-6829-49c8-93c2-57240a461639 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:58.137720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-83332121-6829-49c8-93c2-57240a461639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.217366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 664/1315] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 19 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:58.226795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.228321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.328978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f7c3-7200-4f33-a1e3-d7999475bc55 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.401537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:58.404131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.404956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.405238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.405509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.407150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.515258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.516649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1c92b-dc2e-4b5e-a227-eab72c36560f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.534939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 652/1316] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:01.596221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.596794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.596794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.598019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 665/1317] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:01.603195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9cec8-e025-40a6-a1d4-2ea21870765d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.603646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9cec8-e025-40a6-a1d4-2ea21870765d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.603753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9cec8-e025-40a6-a1d4-2ea21870765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.670020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1ac9cec8-e025-40a6-a1d4-2ea21870765d None None] MFA Rules not processed for user `19d48b7a78714c4cacfe2e4207b6df7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:01.671249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1ac9cec8-e025-40a6-a1d4-2ea21870765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.725241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:01.770850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 653/1318] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:01.808939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.810430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.913921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd6303-9437-484f-9f64-a1dc1b572ab0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.916738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:01.986463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.987098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.987378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.987646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.989283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.097749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.099198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878f4fc-e30c-4f65-a3ba-a4ca3498da99 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.118797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 666/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:05.220786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.221325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.221325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.222680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 654/1320] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:05.227918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f69f5-4022-4280-a09f-b7e3288f5591 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.228387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f69f5-4022-4280-a09f-b7e3288f5591 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.228518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f69f5-4022-4280-a09f-b7e3288f5591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.267597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.291777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-435f69f5-4022-4280-a09f-b7e3288f5591 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:05.293013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-435f69f5-4022-4280-a09f-b7e3288f5591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.389766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 667/1321] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:05.428538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.430058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.529030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e81f3-130e-470b-8d1b-eec8db9b1533 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.599026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.599653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.599928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.600219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.601813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.608989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.706892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.708349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec80eb5-c79f-4efc-9bc5-93beba039955 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.726082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 655/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:09.061852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:09.062409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:09.062409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:09.063774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 668/1323] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:09.069391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae70d-2c06-4bfc-94a0-6f7c050a8b5f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:09.069843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae70d-2c06-4bfc-94a0-6f7c050a8b5f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:09.069980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae70d-2c06-4bfc-94a0-6f7c050a8b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:09.137308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7ddae70d-2c06-4bfc-94a0-6f7c050a8b5f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:09.138694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7ddae70d-2c06-4bfc-94a0-6f7c050a8b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:09.196572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:09.234147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 656/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:09.269977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:09.271582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:09.375598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9ed1-d2dd-4953-b95b-da48624ba49d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:09.388175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:09.448467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:09.449103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:09.449380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:09.449647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:09.451234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:09.556140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:09.557591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481658-5a24-4769-a3ef-c07a5e10f37a service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:09.578358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 669/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:11.845742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:11.846281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:11.846393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:11.847841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 657/1326] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:11.853389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ad0b-8c4e-476a-8073-59324fb765f7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:11.853806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ad0b-8c4e-476a-8073-59324fb765f7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:11.853932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ad0b-8c4e-476a-8073-59324fb765f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:11.900163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:11.918055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c638ad0b-8c4e-476a-8073-59324fb765f7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:11.919249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c638ad0b-8c4e-476a-8073-59324fb765f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:12.017582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 670/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:12.053471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:12.055116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:12.158155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18422c8d-f44b-4f24-8cea-df3262051c80 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:12.231784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:12.232578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:12.232856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:12.233123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:12.234730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:12.251768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:12.345750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:12.347350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e5f85-4b74-480e-b113-5c49bec6d2c8 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:12.364882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 658/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:14.613276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:14.613805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:14.613805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:14.615079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 671/1329] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:14.620467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e9c6-b607-498d-bc27-4a4537d18d27 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:14.620895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e9c6-b607-498d-bc27-4a4537d18d27 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:14.621136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e9c6-b607-498d-bc27-4a4537d18d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:14.685255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9bc9e9c6-b607-498d-bc27-4a4537d18d27 None None] MFA Rules not processed for user `19d48b7a78714c4cacfe2e4207b6df7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:14.686458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9bc9e9c6-b607-498d-bc27-4a4537d18d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:14.752066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:14.784388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 659/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:14.821186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:14.822963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:14.928474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e617c-a554-4fb7-b5c1-6883de8eebf7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:14.948814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:15.000999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:15.001639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:15.001944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:15.002220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:15.003831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:15.111939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:15.113407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113811ca-620a-462a-afe8-3946da5ffd82 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:15.131239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 672/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:17.975710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.976264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.976381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:17.977663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 660/1332] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:17.983000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4692-64d5-40c3-b2db-1da133e36a9d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.983429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4692-64d5-40c3-b2db-1da133e36a9d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.983552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b4692-64d5-40c3-b2db-1da133e36a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.045372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:18.048139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-201b4692-64d5-40c3-b2db-1da133e36a9d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:18.049417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-201b4692-64d5-40c3-b2db-1da133e36a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.146466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 673/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:18.183533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.185086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.288668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc1a1-c269-4365-a5d6-3ea9ce303797 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.362637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.363285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.363562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.363878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.365541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.400042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:18.489084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.490562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f098e-e4d8-494f-9bbf-ca491706ea3c service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.512238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 661/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:20.783653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.784233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.784233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.785604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 674/1335] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:20.790848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24e90-5fde-40aa-a8a5-8c2db1745662 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.791225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24e90-5fde-40aa-a8a5-8c2db1745662 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.791396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24e90-5fde-40aa-a8a5-8c2db1745662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.854641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ace24e90-5fde-40aa-a8a5-8c2db1745662 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.855827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ace24e90-5fde-40aa-a8a5-8c2db1745662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.928534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.951030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 662/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:20.990543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.992049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:21.091859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2695-e31a-4ef1-be09-68ee9818011b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:21.120119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:21.163521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:21.164153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:21.164461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:21.164729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:21.166330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:21.270226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:21.271633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d743c49-62eb-4588-b726-a0b985e58c7f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:21.288758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 675/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:24.065886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.066449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.066449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.067813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 663/1338] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:24.072982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3508-2d8c-421f-b772-3afead9ec118 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.073455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3508-2d8c-421f-b772-3afead9ec118 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.073571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3508-2d8c-421f-b772-3afead9ec118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.137697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-053c3508-2d8c-421f-b772-3afead9ec118 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:24.138881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-053c3508-2d8c-421f-b772-3afead9ec118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:24.147558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:24.236599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 676/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:24.271966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:24.273521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:24.376073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6bff-c500-48a3-aa2b-b5bfde2841e3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:24.446715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:24.447345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.447619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.447885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.449517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:24.485624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:24.558036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:24.559481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63baaf-2d37-4d03-84ab-34307fcf6082 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:24.577471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 664/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:29.172014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:29.173117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:29.173239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:29.174532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 677/1341] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:29.179891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03c96-14f3-4e4e-9d4f-dd91c3ee6d7b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:29.180327 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03c96-14f3-4e4e-9d4f-dd91c3ee6d7b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:29.180499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03c96-14f3-4e4e-9d4f-dd91c3ee6d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:29.254767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-42c03c96-14f3-4e4e-9d4f-dd91c3ee6d7b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:29.255896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42c03c96-14f3-4e4e-9d4f-dd91c3ee6d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:29.347896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:29.360845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 665/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:29.399844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:29.401994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:29.496281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488a27a-87f8-40fc-9474-f7ceabdfba67 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:29.499788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:29.501017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:29.501435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:29.501754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:29.510688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:29.512049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a9cf-219b-4526-9023-ef5df05e20d8 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:29.521454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 678/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:32.873718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c366e8-f146-48f2-ba2c-c2323591e463 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.874309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c366e8-f146-48f2-ba2c-c2323591e463 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.874490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c366e8-f146-48f2-ba2c-c2323591e463 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.875885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 666/1344] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:32.881009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cad60-f2fe-44b9-8c68-5015d373235d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.882157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cad60-f2fe-44b9-8c68-5015d373235d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.882157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cad60-f2fe-44b9-8c68-5015d373235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.910950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-289cad60-f2fe-44b9-8c68-5015d373235d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:32.912138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-289cad60-f2fe-44b9-8c68-5015d373235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:32.941421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:32.991239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 679/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:33.027372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c366e8-f146-48f2-ba2c-c2323591e463 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:33.038395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c366e8-f146-48f2-ba2c-c2323591e463 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:33.041904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:33.042536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.042815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.043086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.052663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:33.054099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91762-1b76-42c1-a8c1-23f72e19c28b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:33.063483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 667/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:37.579845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb043d-5999-4218-afa9-28a7bd72b408 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.580483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb043d-5999-4218-afa9-28a7bd72b408 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.580483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb043d-5999-4218-afa9-28a7bd72b408 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.581808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 680/1347] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:37.587283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf282-5136-430d-b14e-957f868b5631 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.587692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf282-5136-430d-b14e-957f868b5631 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.587961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf282-5136-430d-b14e-957f868b5631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.605631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-48caf282-5136-430d-b14e-957f868b5631 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:37.606748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48caf282-5136-430d-b14e-957f868b5631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.614660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 668/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:37.653830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb043d-5999-4218-afa9-28a7bd72b408 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.664423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb043d-5999-4218-afa9-28a7bd72b408 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.667867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.668533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.668814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.669087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.678492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.679905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6234e-e15b-4b3d-8103-6367102e8383 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.689864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 681/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:43.160006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54954-57d9-4dd7-b52e-569644aff1a0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:43.161541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54954-57d9-4dd7-b52e-569644aff1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:43.162120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54954-57d9-4dd7-b52e-569644aff1a0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:43.165004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 669/1350] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:10:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:43.171490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cd6d-dd40-4eae-9498-b0d2e2ed3566 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:43.172954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cd6d-dd40-4eae-9498-b0d2e2ed3566 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:43.173460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cd6d-dd40-4eae-9498-b0d2e2ed3566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:43.275317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d331cd6d-dd40-4eae-9498-b0d2e2ed3566 None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:43.277123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d331cd6d-dd40-4eae-9498-b0d2e2ed3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:43.432122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 682/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:10:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:47.470594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf344f0-6d0f-4cae-b1e0-1f53d4215ef0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:47.471168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf344f0-6d0f-4cae-b1e0-1f53d4215ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:47.471168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf344f0-6d0f-4cae-b1e0-1f53d4215ef0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:47.473363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 670/1352] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:47.478193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45ae1-f747-4069-8284-b11cd577d01a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:47.478621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45ae1-f747-4069-8284-b11cd577d01a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:47.478750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45ae1-f747-4069-8284-b11cd577d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:47.497508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a6e45ae1-f747-4069-8284-b11cd577d01a None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:47.498676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a6e45ae1-f747-4069-8284-b11cd577d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:47.512164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 683/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:47.600613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=13 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:49.168591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fb3d-9507-4faf-a9fc-b5b567a5f2be None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:49.169269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fb3d-9507-4faf-a9fc-b5b567a5f2be None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:49.169269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fb3d-9507-4faf-a9fc-b5b567a5f2be None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:49.170518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 671/1354] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:49.175569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7156a-b3de-450e-86cf-6aad2e14a718 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:49.175968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7156a-b3de-450e-86cf-6aad2e14a718 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:49.176286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7156a-b3de-450e-86cf-6aad2e14a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:49.194609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e3e7156a-b3de-450e-86cf-6aad2e14a718 None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:49.195883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e3e7156a-b3de-450e-86cf-6aad2e14a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:49.205340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 684/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:53.139602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491340-ebe1-49d3-9409-d4b390375e33 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:53.140167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491340-ebe1-49d3-9409-d4b390375e33 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:53.140167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491340-ebe1-49d3-9409-d4b390375e33 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:53.141795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 672/1356] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:53.146990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488118-547b-48aa-bf8d-1df373798c79 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:53.147395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488118-547b-48aa-bf8d-1df373798c79 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:53.147543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488118-547b-48aa-bf8d-1df373798c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:53.165568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3a488118-547b-48aa-bf8d-1df373798c79 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:53.166738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3a488118-547b-48aa-bf8d-1df373798c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:53.175181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 685/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:53.234700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592ee0-d4a2-49b9-b056-1dec836b6295 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:53.236246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592ee0-d4a2-49b9-b056-1dec836b6295 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:53.237260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592ee0-d4a2-49b9-b056-1dec836b6295 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:53.241210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 673/1358] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 19 12:10:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:53.248735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341912c9-7762-40c1-ae3e-7aad3c0181dc None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:53.249223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341912c9-7762-40c1-ae3e-7aad3c0181dc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:53.249774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341912c9-7762-40c1-ae3e-7aad3c0181dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:53.297724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:53.305362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-341912c9-7762-40c1-ae3e-7aad3c0181dc None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:53.306847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-341912c9-7762-40c1-ae3e-7aad3c0181dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:53.395592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 686/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 19 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:53.403836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592ee0-d4a2-49b9-b056-1dec836b6295 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:53.419835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592ee0-d4a2-49b9-b056-1dec836b6295 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:53.425553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:53.426457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:53.427012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:53.427446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:53.437333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:53.442701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132e4bd-8f79-4191-81f9-d055f958d8a4 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:53.450755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 674/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:55.908010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163c75-e71c-4b25-b509-25bebdbdf1dc None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.908584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163c75-e71c-4b25-b509-25bebdbdf1dc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.908584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163c75-e71c-4b25-b509-25bebdbdf1dc None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.909849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 687/1361] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:55.915044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8deb74-b9d9-4350-aba2-73f5f36bd6b9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.915438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8deb74-b9d9-4350-aba2-73f5f36bd6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.915587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8deb74-b9d9-4350-aba2-73f5f36bd6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.934496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7f8deb74-b9d9-4350-aba2-73f5f36bd6b9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:55.935672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7f8deb74-b9d9-4350-aba2-73f5f36bd6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.943623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 675/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:55.988377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163c75-e71c-4b25-b509-25bebdbdf1dc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.004653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163c75-e71c-4b25-b509-25bebdbdf1dc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.010151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.010790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.011067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.011339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.021983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.023935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fea680-c923-4de2-bec3-6a46e1f965cb service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.034137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 688/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:58.703152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079c13-495e-4201-b746-da13b7eba76a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.703670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079c13-495e-4201-b746-da13b7eba76a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.703768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079c13-495e-4201-b746-da13b7eba76a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.705193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 676/1364] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:10:58.710377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a446e-6add-4ee8-ab16-380c098fba87 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.710783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a446e-6add-4ee8-ab16-380c098fba87 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.710921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a446e-6add-4ee8-ab16-380c098fba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.728664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-910a446e-6add-4ee8-ab16-380c098fba87 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:58.730165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-910a446e-6add-4ee8-ab16-380c098fba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:58.742292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 689/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:58.789251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add3e-a504-4974-b464-2e318c394180 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.789530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add3e-a504-4974-b464-2e318c394180 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.789806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add3e-a504-4974-b464-2e318c394180 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.791208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 677/1366] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 19 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:10:58.797306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff338df-61be-445a-81d3-86b4d58755e8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.797593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff338df-61be-445a-81d3-86b4d58755e8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.797871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff338df-61be-445a-81d3-86b4d58755e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.816566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9ff338df-61be-445a-81d3-86b4d58755e8 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:58.817746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9ff338df-61be-445a-81d3-86b4d58755e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:58.827056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 690/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:58.835135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037add3e-a504-4974-b464-2e318c394180 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.849230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037add3e-a504-4974-b464-2e318c394180 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.854565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.855315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.855598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.855871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.864477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.866094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d824f99-264a-4b65-8f54-ce932a9ef925 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.876160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 678/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:01.346354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8d76-ff4b-48f5-82a8-476be1ff8694 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.346945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8d76-ff4b-48f5-82a8-476be1ff8694 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.346945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8d76-ff4b-48f5-82a8-476be1ff8694 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.348719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 691/1369] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:01.354569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c709-4bd6-4e12-9615-554c7416e45a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.355132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c709-4bd6-4e12-9615-554c7416e45a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.355132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c709-4bd6-4e12-9615-554c7416e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.375293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5896c709-4bd6-4e12-9615-554c7416e45a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:01.376553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5896c709-4bd6-4e12-9615-554c7416e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:01.384887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 679/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:01.430735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8d76-ff4b-48f5-82a8-476be1ff8694 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:01.446256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8d76-ff4b-48f5-82a8-476be1ff8694 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:01.451965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:01.452717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.453003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.453280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.462788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:01.464422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0596e8-1a20-455e-b0d1-378fd062c1fa service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:01.476535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 692/1371] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:11:01.538961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d5b5-ec5b-4428-893b-b6dabc577913 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.539240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d5b5-ec5b-4428-893b-b6dabc577913 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.539510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d5b5-ec5b-4428-893b-b6dabc577913 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.540989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 680/1372] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:01.547047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb479c6-d31a-44be-b718-4d06d630628f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.547672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb479c6-d31a-44be-b718-4d06d630628f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.548016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb479c6-d31a-44be-b718-4d06d630628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.566790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dcb479c6-d31a-44be-b718-4d06d630628f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:01.568114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dcb479c6-d31a-44be-b718-4d06d630628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:01.577261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 693/1373] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:01.903022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0538-546b-4405-8bd4-02c46bab0a3b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.903022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0538-546b-4405-8bd4-02c46bab0a3b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.903022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0538-546b-4405-8bd4-02c46bab0a3b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.903022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 681/1374] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 19 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:01.906847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a531-0744-45a5-836a-6fc6d4405614 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:01.907128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a531-0744-45a5-836a-6fc6d4405614 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:01.907399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a531-0744-45a5-836a-6fc6d4405614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:01.961590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c62a531-0744-45a5-836a-6fc6d4405614 None None] MFA Rules not processed for user `5ab02d4594794adca8c3188d0a9d3d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:01.962707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c62a531-0744-45a5-836a-6fc6d4405614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.026644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 694/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 19 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:02.034902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0538-546b-4405-8bd4-02c46bab0a3b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:02.047779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0538-546b-4405-8bd4-02c46bab0a3b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:02.053259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:02.053259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.053767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.054108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.063977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:02.065510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aae42-4aa2-47a2-9865-3737ab64eb53 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:02.076400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 682/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:03.891704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea9f7-4ed7-4115-ad5d-22383c414b7d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:03.892324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea9f7-4ed7-4115-ad5d-22383c414b7d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:03.892324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea9f7-4ed7-4115-ad5d-22383c414b7d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:03.893664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 695/1377] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:03.899867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db616-ee93-41bc-9ee2-78de052aa107 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:03.900443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db616-ee93-41bc-9ee2-78de052aa107 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:03.900443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db616-ee93-41bc-9ee2-78de052aa107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:03.919143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a91db616-ee93-41bc-9ee2-78de052aa107 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:03.920416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a91db616-ee93-41bc-9ee2-78de052aa107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:03.929247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 683/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:03.974450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea9f7-4ed7-4115-ad5d-22383c414b7d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:03.989829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea9f7-4ed7-4115-ad5d-22383c414b7d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:03.995677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:03.996368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:03.996648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:03.996917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.006939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:04.008574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9c69-af64-4954-bdbd-ff485c866674 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:04.012889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:04.019200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 696/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:06.468836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2aa3e-161f-4e92-b54f-f88615931413 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.469396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2aa3e-161f-4e92-b54f-f88615931413 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.469396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2aa3e-161f-4e92-b54f-f88615931413 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.470751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 684/1380] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:06.476099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cc59-6898-45a2-8f78-7005992cea41 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.476560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cc59-6898-45a2-8f78-7005992cea41 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.476693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cc59-6898-45a2-8f78-7005992cea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.495691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7872cc59-6898-45a2-8f78-7005992cea41 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:06.496917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7872cc59-6898-45a2-8f78-7005992cea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.505332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 697/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:06.549369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2aa3e-161f-4e92-b54f-f88615931413 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.565219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2aa3e-161f-4e92-b54f-f88615931413 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.570849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.571484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.571765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.572039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.580941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.582523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa64ee-ee0c-4df5-b365-910cc3d89c8a service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.592248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 685/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:09.052580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62308a96-5d30-4e48-abc2-eb29cf2d797a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.053169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62308a96-5d30-4e48-abc2-eb29cf2d797a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.053169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62308a96-5d30-4e48-abc2-eb29cf2d797a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.054685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 698/1383] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:09.060188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895fb-6aed-4eb8-a19f-a06e9408b604 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.060676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895fb-6aed-4eb8-a19f-a06e9408b604 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.060775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb895fb-6aed-4eb8-a19f-a06e9408b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.079085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dcb895fb-6aed-4eb8-a19f-a06e9408b604 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:09.080567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dcb895fb-6aed-4eb8-a19f-a06e9408b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:09.088791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 686/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:09.131890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62308a96-5d30-4e48-abc2-eb29cf2d797a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:09.147263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62308a96-5d30-4e48-abc2-eb29cf2d797a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:09.152981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:09.153624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.153902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.154172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.163445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:09.165039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9cf56-4c46-43eb-ae13-835eff20d2be service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:09.175186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 699/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:11.426487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4c3d-0cc3-4ee9-b778-9d5ae22f609b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.427043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4c3d-0cc3-4ee9-b778-9d5ae22f609b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.427043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4c3d-0cc3-4ee9-b778-9d5ae22f609b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.428618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 687/1386] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:11.433667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7330-3315-42ea-8ca7-45c5b1e05f51 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.434064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7330-3315-42ea-8ca7-45c5b1e05f51 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.434219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7330-3315-42ea-8ca7-45c5b1e05f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.453067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7fcd7330-3315-42ea-8ca7-45c5b1e05f51 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:11.454276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fcd7330-3315-42ea-8ca7-45c5b1e05f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:11.462164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 700/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:11.506017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a4c3d-0cc3-4ee9-b778-9d5ae22f609b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.520011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a4c3d-0cc3-4ee9-b778-9d5ae22f609b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.525347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.525973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.526251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.526517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.534572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.536166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5ea15-68d0-461f-82e4-f3acb3f9ba4f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.545371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 688/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:13.932388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1729c19-bf87-419e-8e07-786b4cbed35f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:13.932945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1729c19-bf87-419e-8e07-786b4cbed35f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:13.933276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1729c19-bf87-419e-8e07-786b4cbed35f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:13.935300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 701/1389] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:13.942428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e876-c105-4d71-add7-6a403da34871 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:13.942880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e876-c105-4d71-add7-6a403da34871 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:13.943175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e876-c105-4d71-add7-6a403da34871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:13.965026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4ff3e876-c105-4d71-add7-6a403da34871 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:13.966207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4ff3e876-c105-4d71-add7-6a403da34871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:13.973994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 689/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:14.019261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1729c19-bf87-419e-8e07-786b4cbed35f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:14.038018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1729c19-bf87-419e-8e07-786b4cbed35f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:14.045203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:14.046260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:14.046640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:14.047055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:14.057829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:14.059924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3165b-b919-4a73-9c62-72a0934d5a80 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:14.073681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 702/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:16.477387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245642-7195-450b-9b31-3ccc12db6e40 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:16.477975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245642-7195-450b-9b31-3ccc12db6e40 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:16.477975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245642-7195-450b-9b31-3ccc12db6e40 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:16.479298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 690/1392] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:16.484955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5f88-2d00-4810-9bea-2906ce211a14 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:16.485403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5f88-2d00-4810-9bea-2906ce211a14 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:16.485586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5f88-2d00-4810-9bea-2906ce211a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:16.503630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2fcb5f88-2d00-4810-9bea-2906ce211a14 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:16.505313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2fcb5f88-2d00-4810-9bea-2906ce211a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:16.513632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 703/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:16.557557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245642-7195-450b-9b31-3ccc12db6e40 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:16.577932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245642-7195-450b-9b31-3ccc12db6e40 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:16.583301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:16.583943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:16.584242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:16.584516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:16.593182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:16.594762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fdb89-5589-44f5-ba9f-af7ce2e8a8bb service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:16.604561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 691/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:18.071803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7108-3200-4d80-bde4-c06c588b285f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:18.072391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7108-3200-4d80-bde4-c06c588b285f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:18.072391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7108-3200-4d80-bde4-c06c588b285f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:18.073784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 704/1395] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:18.079813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6a1a-e901-4e3c-9a05-2fa1cc81bf44 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:18.080248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6a1a-e901-4e3c-9a05-2fa1cc81bf44 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:18.080406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6a1a-e901-4e3c-9a05-2fa1cc81bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:18.086601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=52 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:18.098330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-42bc6a1a-e901-4e3c-9a05-2fa1cc81bf44 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:18.101256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42bc6a1a-e901-4e3c-9a05-2fa1cc81bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:18.107577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 692/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:18.162956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badab21-b6f8-43dd-809b-194fec7f60c0 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:18.163243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badab21-b6f8-43dd-809b-194fec7f60c0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:18.163516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badab21-b6f8-43dd-809b-194fec7f60c0 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:18.164976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 705/1397] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 19 12:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:18.169869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211d72-c273-48aa-b9ed-a556c25cb49b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:18.170281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211d72-c273-48aa-b9ed-a556c25cb49b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:18.171050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211d72-c273-48aa-b9ed-a556c25cb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:18.219001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8e211d72-c273-48aa-b9ed-a556c25cb49b None None] MFA Rules not processed for user `68f54fc2f2ba403c8fd8c871740d3403`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:18.220177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e211d72-c273-48aa-b9ed-a556c25cb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:18.278912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 693/1398] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 19 12:11:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:18.286627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badab21-b6f8-43dd-809b-194fec7f60c0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:18.297547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badab21-b6f8-43dd-809b-194fec7f60c0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:18.301007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:18.301632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:18.301918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:18.302187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:18.310910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:18.312935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa512cf4-1a56-44c0-ae33-5d362a3767f4 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:18.322872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 706/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:19.049494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806219-58e2-4813-9c59-f180e095aab1 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.058226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806219-58e2-4813-9c59-f180e095aab1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.058226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806219-58e2-4813-9c59-f180e095aab1 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.058226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 694/1400] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:19.058540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.058540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.058540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.076316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:19.078246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:19.086020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 707/1401] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:19.095267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78bbb-e055-45fb-b9ac-e0266fcc255b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.095730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78bbb-e055-45fb-b9ac-e0266fcc255b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.095911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78bbb-e055-45fb-b9ac-e0266fcc255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.130480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:19.142563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc260-5705-4207-8e02-659ec4e5fb56 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:19.146989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1ba78bbb-e055-45fb-b9ac-e0266fcc255b None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:19.154555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1ba78bbb-e055-45fb-b9ac-e0266fcc255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:19.154691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:19.154691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.154691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.154691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.160947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:19.162513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb26883-bef0-4ec7-89a0-b9c322f2b857 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:19.172753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 708/1402] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:11:19.218571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 695/1403] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:19.259835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23626-e10e-4a39-95e0-f856d4491a38 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.260113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23626-e10e-4a39-95e0-f856d4491a38 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.260608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23626-e10e-4a39-95e0-f856d4491a38 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.262696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 709/1404] 10.222.0.60 () {54 vars in 942 bytes} [Thu May 19 12:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:19.269237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9fc6-af9a-4434-806f-04bf7e06954e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.269524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9fc6-af9a-4434-806f-04bf7e06954e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.269794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9fc6-af9a-4434-806f-04bf7e06954e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.319421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0b3e9fc6-af9a-4434-806f-04bf7e06954e None None] MFA Rules not processed for user `3c9fc3f5c10a4b47bca065dcd516fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:19.320684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0b3e9fc6-af9a-4434-806f-04bf7e06954e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:19.334292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:19.393052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 696/1405] 10.222.0.60 () {58 vars in 1039 bytes} [Thu May 19 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:19.402298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23626-e10e-4a39-95e0-f856d4491a38 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:19.416867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23626-e10e-4a39-95e0-f856d4491a38 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:19.422542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:19.423170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:19.424923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:19.424923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:19.431812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:19.433387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed1e8-0ef0-462a-be2e-25eabbf5e9d2 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:19.441561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 710/1406] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:11:21.761884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde698-9720-4971-bb56-3b6f70053bf0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:21.762419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde698-9720-4971-bb56-3b6f70053bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:21.762504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dde698-9720-4971-bb56-3b6f70053bf0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:21.764832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 697/1407] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:11:21.770285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263965-a93b-4fc0-91e2-d067dee4a53d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:21.770698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263965-a93b-4fc0-91e2-d067dee4a53d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:21.770889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263965-a93b-4fc0-91e2-d067dee4a53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:21.791699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2a263965-a93b-4fc0-91e2-d067dee4a53d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:21.793117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2a263965-a93b-4fc0-91e2-d067dee4a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:21.808810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 711/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:21.858369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dde698-9720-4971-bb56-3b6f70053bf0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:21.873210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dde698-9720-4971-bb56-3b6f70053bf0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:21.880751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:21.881393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:21.881677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:21.881940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:21.891233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:21.892861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef8fc0-d84d-4c09-9a7b-feef287a757f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:21.908416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 698/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:31.784274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=46 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:31.898038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=30 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:45.521294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a35eb-03fb-4260-a54e-57e1d77bec9c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:45.521965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a35eb-03fb-4260-a54e-57e1d77bec9c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:45.521965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a35eb-03fb-4260-a54e-57e1d77bec9c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:45.523228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 712/1410] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 19 12:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:45.528733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea16f-962e-4951-8fd3-b9e0fa986e39 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:45.529748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea16f-962e-4951-8fd3-b9e0fa986e39 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:45.529858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea16f-962e-4951-8fd3-b9e0fa986e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:45.548090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-538ea16f-962e-4951-8fd3-b9e0fa986e39 None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:45.549315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-538ea16f-962e-4951-8fd3-b9e0fa986e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:45.557798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 699/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 19 12:11:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:45.572264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc9b2-f660-4d48-9598-2b3fa9ed2d17 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:45.572552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc9b2-f660-4d48-9598-2b3fa9ed2d17 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:45.572821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc9b2-f660-4d48-9598-2b3fa9ed2d17 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:45.574174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 713/1412] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 19 12:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:45.579474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f623-2a77-419f-91d0-bd15edcd6892 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:45.579782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f623-2a77-419f-91d0-bd15edcd6892 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:45.580061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f623-2a77-419f-91d0-bd15edcd6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:45.598535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0586f623-2a77-419f-91d0-bd15edcd6892 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:45.599654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0586f623-2a77-419f-91d0-bd15edcd6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:45.608757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 700/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 19 12:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:48.300288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd318c1-ff6d-40b4-9c3c-7b71ac85fe6e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:48.300860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd318c1-ff6d-40b4-9c3c-7b71ac85fe6e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:48.300860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd318c1-ff6d-40b4-9c3c-7b71ac85fe6e None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:48.302186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:48.307472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c4b9-e433-41d0-9e3c-86ad32e408a8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:48.307876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c4b9-e433-41d0-9e3c-86ad32e408a8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:48.308028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9c4b9-e433-41d0-9e3c-86ad32e408a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:48.326960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d6c9c4b9-e433-41d0-9e3c-86ad32e408a8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:48.328150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d6c9c4b9-e433-41d0-9e3c-86ad32e408a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:48.335886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:48.378599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd318c1-ff6d-40b4-9c3c-7b71ac85fe6e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:48.393192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd318c1-ff6d-40b4-9c3c-7b71ac85fe6e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:48.398546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:48.399180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:48.399462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:48.399735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:48.407973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:48.409710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3a888-7deb-4177-a2e1-0c17cddf62d0 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:48.419544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 715/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:49.437599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6b88-8295-4de9-9267-87bbd6d9f875 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:49.438167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6b88-8295-4de9-9267-87bbd6d9f875 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:49.438167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6b88-8295-4de9-9267-87bbd6d9f875 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:49.439466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:11:49.444721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cad05-e596-4758-abd8-668ddb2e243a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:49.445141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cad05-e596-4758-abd8-668ddb2e243a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:49.445401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cad05-e596-4758-abd8-668ddb2e243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:49.463994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fe5cad05-e596-4758-abd8-668ddb2e243a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:49.465221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fe5cad05-e596-4758-abd8-668ddb2e243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:49.473781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:49.631444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af6b88-8295-4de9-9267-87bbd6d9f875 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:49.646137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af6b88-8295-4de9-9267-87bbd6d9f875 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:49.651540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:49.652172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:49.652482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:49.652752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:49.661692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:49.663279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d7873-f5f6-4196-9f27-95d8396aceab service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:49.672910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 703/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:50.641359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4618-551c-41f9-a15e-04ffc27f33cb None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:50.641913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4618-551c-41f9-a15e-04ffc27f33cb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:50.641913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4618-551c-41f9-a15e-04ffc27f33cb None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:50.643292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:50.648426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645132a3-0860-4720-bbf8-b845b5f7a659 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:50.648825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645132a3-0860-4720-bbf8-b845b5f7a659 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:50.648984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645132a3-0860-4720-bbf8-b845b5f7a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:50.666818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-645132a3-0860-4720-bbf8-b845b5f7a659 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:50.668014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-645132a3-0860-4720-bbf8-b845b5f7a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:50.675856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:50.833423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4618-551c-41f9-a15e-04ffc27f33cb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:50.847583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4618-551c-41f9-a15e-04ffc27f33cb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:50.852996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:50.853641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:50.853921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:50.854195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:50.863184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:50.864807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74652-fdd9-4865-92d0-98f2d30005f1 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:50.874902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 718/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:51.809672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072447-8ea7-4514-b4a5-2be4567ef091 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:51.810228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072447-8ea7-4514-b4a5-2be4567ef091 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:51.810228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072447-8ea7-4514-b4a5-2be4567ef091 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:51.811905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:51.817325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1ad7-c34f-4e5e-802b-ecc045c65ccf None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:51.817745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1ad7-c34f-4e5e-802b-ecc045c65ccf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:51.817908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1ad7-c34f-4e5e-802b-ecc045c65ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:51.836117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-efba1ad7-c34f-4e5e-802b-ecc045c65ccf None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:51.837366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-efba1ad7-c34f-4e5e-802b-ecc045c65ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:51.846098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:51.999716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b072447-8ea7-4514-b4a5-2be4567ef091 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.014408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b072447-8ea7-4514-b4a5-2be4567ef091 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.019706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:52.020370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.020655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.020925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.028958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:52.030542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16430-91c4-4289-ade0-f21cd9d941c6 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:52.039617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 706/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:52.972898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d317d2-04f2-4acb-b634-cc577e6ca28d None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.973475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d317d2-04f2-4acb-b634-cc577e6ca28d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.973475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d317d2-04f2-4acb-b634-cc577e6ca28d None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.974893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:52.979840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2da7-36ca-4ff3-ab09-af35b928c419 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.980286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2da7-36ca-4ff3-ab09-af35b928c419 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.980446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2da7-36ca-4ff3-ab09-af35b928c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.998733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7cfd2da7-36ca-4ff3-ab09-af35b928c419 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:52.999911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7cfd2da7-36ca-4ff3-ab09-af35b928c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:53.007763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:53.159355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d317d2-04f2-4acb-b634-cc577e6ca28d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.174288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d317d2-04f2-4acb-b634-cc577e6ca28d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.179891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.180470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.180750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.181027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.190058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.191923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab87b3-5d20-40cd-8c12-4f8c30b5dabf service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.201862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 721/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:54.175037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edfe8-feba-493f-9045-03fff5b5df0d None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:54.175628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edfe8-feba-493f-9045-03fff5b5df0d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:54.175628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edfe8-feba-493f-9045-03fff5b5df0d None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:54.177173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:54.182566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ee2c-a0b0-472d-a7b1-52556c20b1ff None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:54.183010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ee2c-a0b0-472d-a7b1-52556c20b1ff None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:54.183118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ee2c-a0b0-472d-a7b1-52556c20b1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:54.201703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7b01ee2c-a0b0-472d-a7b1-52556c20b1ff None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:54.202908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7b01ee2c-a0b0-472d-a7b1-52556c20b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:54.210504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:54.360718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141edfe8-feba-493f-9045-03fff5b5df0d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:54.376209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141edfe8-feba-493f-9045-03fff5b5df0d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:54.381728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:54.382365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:54.382648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:54.382922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:54.391718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:54.393409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676af4-7555-4daf-b89e-fd356967036f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:54.402765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 709/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:55.371804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c3adc-272a-4869-b4da-d13f7e5adbbf None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.372312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c3adc-272a-4869-b4da-d13f7e5adbbf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.372428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c3adc-272a-4869-b4da-d13f7e5adbbf None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.373868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:11:55.378769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff79ca-45ed-452d-ab37-ee006abf28b6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.379206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff79ca-45ed-452d-ab37-ee006abf28b6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.379303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff79ca-45ed-452d-ab37-ee006abf28b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.397268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9fff79ca-45ed-452d-ab37-ee006abf28b6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:55.398436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9fff79ca-45ed-452d-ab37-ee006abf28b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:55.406880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:55.558090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c3adc-272a-4869-b4da-d13f7e5adbbf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:55.572916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c3adc-272a-4869-b4da-d13f7e5adbbf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:55.578166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:55.578818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.579178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.579451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.587373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:55.588964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6684ba-6ce9-4e2a-8da3-5c31778064bd service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:55.598109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 724/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:56.553897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49dc2-5c9c-4076-999f-1f87465a1827 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.554450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49dc2-5c9c-4076-999f-1f87465a1827 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.554450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49dc2-5c9c-4076-999f-1f87465a1827 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.555813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:56.561723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397664a5-601c-4420-93fb-5fd0d6b3de14 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.562238 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397664a5-601c-4420-93fb-5fd0d6b3de14 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.562390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397664a5-601c-4420-93fb-5fd0d6b3de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.580826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-397664a5-601c-4420-93fb-5fd0d6b3de14 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:56.582011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-397664a5-601c-4420-93fb-5fd0d6b3de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:56.589674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:56.740095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49dc2-5c9c-4076-999f-1f87465a1827 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:56.755147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49dc2-5c9c-4076-999f-1f87465a1827 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:56.760368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:56.761006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.761282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.761553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.770399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:56.772001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5dacc-691d-4015-b542-cc2ca16f2b87 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:56.781331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 712/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:57.725396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beab08-1534-43dd-b62c-7e1052df915f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.725942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beab08-1534-43dd-b62c-7e1052df915f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.726040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beab08-1534-43dd-b62c-7e1052df915f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.727417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:11:57.732852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a042-e1eb-4e63-aa75-3edd06019fb9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.732852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a042-e1eb-4e63-aa75-3edd06019fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.732852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a042-e1eb-4e63-aa75-3edd06019fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.751591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4c08a042-e1eb-4e63-aa75-3edd06019fb9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:57.752798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4c08a042-e1eb-4e63-aa75-3edd06019fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:57.760645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:57.912344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beab08-1534-43dd-b62c-7e1052df915f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:57.927176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beab08-1534-43dd-b62c-7e1052df915f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.932748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.933389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.933692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.933975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.943055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.944749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac8c8-51ef-4c0e-8e7b-2484fa04e2c1 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.954606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 727/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:00.094697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:00.095514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:00.095514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:00.096985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:00.102274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5917b-e18a-42cb-948e-e96990e7038e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:00.102717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5917b-e18a-42cb-948e-e96990e7038e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:00.102829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5917b-e18a-42cb-948e-e96990e7038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:00.122425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dab5917b-e18a-42cb-948e-e96990e7038e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:00.124321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dab5917b-e18a-42cb-948e-e96990e7038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:00.133227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:00.172247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:00.173993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:00.187387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c5f6-a025-42a5-b98b-fc83874092f3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:00.190855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:00.191482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:00.192007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:00.192304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:00.201025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:00.202446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb557b7b-090f-49d6-a0f1-8e29ab15cd62 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:00.211490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 715/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:02.626605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099011a-01f0-4522-a0d9-777d3b834443 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:02.627120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099011a-01f0-4522-a0d9-777d3b834443 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:02.627347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099011a-01f0-4522-a0d9-777d3b834443 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:02.628891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:02.634465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c993590-62e2-489d-b127-efe06c98147e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:02.634915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c993590-62e2-489d-b127-efe06c98147e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:02.635016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c993590-62e2-489d-b127-efe06c98147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:02.652553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7c993590-62e2-489d-b127-efe06c98147e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:02.654370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7c993590-62e2-489d-b127-efe06c98147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:02.663079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:02.701399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099011a-01f0-4522-a0d9-777d3b834443 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:02.711905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099011a-01f0-4522-a0d9-777d3b834443 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:02.715393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:02.716673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:02.716899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:02.717169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:02.725971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:02.727422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce127350-b447-4d16-a9af-c2ad1ac53732 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:02.737926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 730/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:05.447377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db149dbb-f9f0-485f-bf71-cae89ac73b75 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:05.448012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db149dbb-f9f0-485f-bf71-cae89ac73b75 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:05.448012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db149dbb-f9f0-485f-bf71-cae89ac73b75 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:05.449338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:05.455142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae50-8567-4cc6-b572-00aa77d59145 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:05.455615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae50-8567-4cc6-b572-00aa77d59145 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:05.455721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcae50-8567-4cc6-b572-00aa77d59145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:05.473148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6ddcae50-8567-4cc6-b572-00aa77d59145 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:05.474345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6ddcae50-8567-4cc6-b572-00aa77d59145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:05.482033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:05.520246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db149dbb-f9f0-485f-bf71-cae89ac73b75 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:05.530825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db149dbb-f9f0-485f-bf71-cae89ac73b75 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:05.535105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:05.535732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:05.536011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:05.536320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:05.545178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:05.546592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc8725-cf2f-47c0-9b4a-e0a12d16701d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:05.555754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 718/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:07.890021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760861-791f-483f-a4c6-78ccdf9c7b64 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:07.890585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760861-791f-483f-a4c6-78ccdf9c7b64 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:07.890585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760861-791f-483f-a4c6-78ccdf9c7b64 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:07.891924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:07.897289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444309ec-98ad-4ea3-b9b3-905b9c5a8635 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:07.897730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444309ec-98ad-4ea3-b9b3-905b9c5a8635 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:07.897843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444309ec-98ad-4ea3-b9b3-905b9c5a8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:07.915724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-444309ec-98ad-4ea3-b9b3-905b9c5a8635 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:07.918559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-444309ec-98ad-4ea3-b9b3-905b9c5a8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:07.924780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:12:07.963850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760861-791f-483f-a4c6-78ccdf9c7b64 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:07.975530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760861-791f-483f-a4c6-78ccdf9c7b64 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:07.979074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:07.980163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:07.980466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:07.980736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:07.990515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:07.991965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570270a2-43d3-4d99-b7f6-bb245e525173 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:08.002050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 733/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:10.700162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363663d-a0a2-4182-9c78-9e6afbd53d4c None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:10.701364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363663d-a0a2-4182-9c78-9e6afbd53d4c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:10.701364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363663d-a0a2-4182-9c78-9e6afbd53d4c None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:10.702587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:10.709667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac92c-10a4-4c4b-b064-163bedb5f4a1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:10.709667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac92c-10a4-4c4b-b064-163bedb5f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:10.710433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac92c-10a4-4c4b-b064-163bedb5f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:10.728891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-21cac92c-10a4-4c4b-b064-163bedb5f4a1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:10.730263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-21cac92c-10a4-4c4b-b064-163bedb5f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:10.738417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:10.777117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363663d-a0a2-4182-9c78-9e6afbd53d4c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:10.789517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363663d-a0a2-4182-9c78-9e6afbd53d4c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:10.793122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:10.793743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:10.794020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:10.794294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:10.803671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:10.805136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f54e9-b260-41cf-9ab6-51915bfa76f8 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:10.815170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 721/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:13.224497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baafec-8501-4d10-8b43-cba9f7d8ccb4 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:13.225106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baafec-8501-4d10-8b43-cba9f7d8ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:13.225106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baafec-8501-4d10-8b43-cba9f7d8ccb4 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:13.226503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:13.232527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de373b-d343-45d5-a8ce-c8cff2c05316 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:13.238929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de373b-d343-45d5-a8ce-c8cff2c05316 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:13.238929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de373b-d343-45d5-a8ce-c8cff2c05316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:13.239994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=70 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:13.253504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f9de373b-d343-45d5-a8ce-c8cff2c05316 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:13.255041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f9de373b-d343-45d5-a8ce-c8cff2c05316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:13.264398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:12:13.311157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baafec-8501-4d10-8b43-cba9f7d8ccb4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:13.317005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=64 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:13.324900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baafec-8501-4d10-8b43-cba9f7d8ccb4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:13.328809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:13.329493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:13.329775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:13.330046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:13.342882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:13.344348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26117e-e247-484b-9292-a0443801b9ba service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:13.361014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 736/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:12:15.701755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41b5a-330f-4fe4-9ad0-3f989b5d7662 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:15.702291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41b5a-330f-4fe4-9ad0-3f989b5d7662 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:15.702291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41b5a-330f-4fe4-9ad0-3f989b5d7662 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:15.703573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:15.712467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb267f18-9224-4ae7-8d1b-d6055b9bc31b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:15.713000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb267f18-9224-4ae7-8d1b-d6055b9bc31b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:15.713000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb267f18-9224-4ae7-8d1b-d6055b9bc31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:15.731355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cb267f18-9224-4ae7-8d1b-d6055b9bc31b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:15.732638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cb267f18-9224-4ae7-8d1b-d6055b9bc31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:15.740932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:15.779772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc41b5a-330f-4fe4-9ad0-3f989b5d7662 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:15.792672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc41b5a-330f-4fe4-9ad0-3f989b5d7662 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:15.796404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:15.797244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:15.797530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:15.797805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:15.808449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:15.809994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f93d2-b06e-4dbb-aed6-8c3235166a2a service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:15.820933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 724/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:18.145492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ff2e-a3bd-4c46-bb2a-914e64ea556f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:18.146022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ff2e-a3bd-4c46-bb2a-914e64ea556f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:18.146022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ff2e-a3bd-4c46-bb2a-914e64ea556f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:18.147400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:18.153070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f02b-9720-46fd-a5b5-1d122db9b00e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:18.154268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f02b-9720-46fd-a5b5-1d122db9b00e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:18.154268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f02b-9720-46fd-a5b5-1d122db9b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:18.171813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4a78f02b-9720-46fd-a5b5-1d122db9b00e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:18.173022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4a78f02b-9720-46fd-a5b5-1d122db9b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:18.180976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:18.218415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ff2e-a3bd-4c46-bb2a-914e64ea556f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:18.228949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ff2e-a3bd-4c46-bb2a-914e64ea556f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:18.232381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:18.233008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:18.233285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:18.233556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:18.242383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:18.243791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81cfc1-21a4-47da-aeb4-c80d43696ccc service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:18.253546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 739/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:20.542661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9489-4884-4e5f-b7d7-c7e18d57740f None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:20.543191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9489-4884-4e5f-b7d7-c7e18d57740f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:20.543313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9489-4884-4e5f-b7d7-c7e18d57740f None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:20.545652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:20.551209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715004-f92c-453e-b190-1258181f1dc0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:20.551644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715004-f92c-453e-b190-1258181f1dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:20.551752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715004-f92c-453e-b190-1258181f1dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:20.569714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-33715004-f92c-453e-b190-1258181f1dc0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:20.570913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-33715004-f92c-453e-b190-1258181f1dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:20.578756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:20.615563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b9489-4884-4e5f-b7d7-c7e18d57740f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:20.627055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b9489-4884-4e5f-b7d7-c7e18d57740f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:20.630658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:20.631326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:20.631683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:20.631971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:20.641271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:20.642706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a728-7462-455d-a539-7998c3e12419 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:20.652571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 727/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:22.998973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a5c-4fa1-491e-ac40-4ca99b84256b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:22.999521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a5c-4fa1-491e-ac40-4ca99b84256b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:22.999521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a5c-4fa1-491e-ac40-4ca99b84256b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:23.000931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:23.006799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4098cd-dbe4-4699-8d14-3294b9eeb72b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:23.007238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4098cd-dbe4-4699-8d14-3294b9eeb72b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:23.007335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4098cd-dbe4-4699-8d14-3294b9eeb72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:23.025227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3c4098cd-dbe4-4699-8d14-3294b9eeb72b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:23.026411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3c4098cd-dbe4-4699-8d14-3294b9eeb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:23.034015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:23.072073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28a5c-4fa1-491e-ac40-4ca99b84256b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:23.083166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28a5c-4fa1-491e-ac40-4ca99b84256b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:23.086956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:23.087623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:23.087909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:23.088212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:23.098589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:23.100071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce16431-d9c9-45fd-aea7-eb6d23a479ff service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:23.110673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 742/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:33.020131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=20 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:33.106235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=23 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:57.194228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819b1e-975f-4f71-9352-6f20f60a0cc6 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:57.194909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819b1e-975f-4f71-9352-6f20f60a0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:57.194909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35819b1e-975f-4f71-9352-6f20f60a0cc6 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:57.196176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 729/1471] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:57.203021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a62-06f7-4373-a099-a294ce7cdc33 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:57.203534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a62-06f7-4373-a099-a294ce7cdc33 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:57.203645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a62-06f7-4373-a099-a294ce7cdc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:57.224252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-78538a62-06f7-4373-a099-a294ce7cdc33 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:57.225454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-78538a62-06f7-4373-a099-a294ce7cdc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:57.234064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 743/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:57.281743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3cb1-66fb-4631-9092-f99b276ce723 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:57.282072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3cb1-66fb-4631-9092-f99b276ce723 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:57.282576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3cb1-66fb-4631-9092-f99b276ce723 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:57.283919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 730/1473] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 19 12:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:57.290358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd71b-0a87-4258-ab78-8fa8ae0cd844 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:57.290649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd71b-0a87-4258-ab78-8fa8ae0cd844 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:57.291197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd71b-0a87-4258-ab78-8fa8ae0cd844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:57.310133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c10cd71b-0a87-4258-ab78-8fa8ae0cd844 None None] MFA Rules not processed for user `68f54fc2f2ba403c8fd8c871740d3403`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:57.311335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c10cd71b-0a87-4258-ab78-8fa8ae0cd844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:57.318306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 744/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 19 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:57.326530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a3cb1-66fb-4631-9092-f99b276ce723 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:57.338012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a3cb1-66fb-4631-9092-f99b276ce723 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:57.341541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:57.342176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:57.342454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:57.342724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:57.352463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:57.353896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7adf60-152d-4a19-bb28-f103e0558637 service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:57.363533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 731/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:59.714727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b517de-8d41-4b71-b79d-95bb089ec9a8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:59.715249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b517de-8d41-4b71-b79d-95bb089ec9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:59.715380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b517de-8d41-4b71-b79d-95bb089ec9a8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:59.716695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 745/1476] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:12:59.721976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf728-b10d-43e9-bea2-2c81b2cb4b59 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:59.722416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf728-b10d-43e9-bea2-2c81b2cb4b59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:59.722522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf728-b10d-43e9-bea2-2c81b2cb4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:59.740491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-056bf728-b10d-43e9-bea2-2c81b2cb4b59 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:59.741687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-056bf728-b10d-43e9-bea2-2c81b2cb4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:59.750322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 732/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:59.773837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b517de-8d41-4b71-b79d-95bb089ec9a8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:59.786153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b517de-8d41-4b71-b79d-95bb089ec9a8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:59.790493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:59.791135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:59.791413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:59.791684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:59.792941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:59.794735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:12:59.794735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:12:59.794735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:12:59.795865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878adc59-8ed1-4937-ae9d-e62d338026ee admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:59.815248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 746/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 19 12:12:59 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:13:02.094047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1315-9ac1-4fa7-926b-0054f794869a None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:02.094634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1315-9ac1-4fa7-926b-0054f794869a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:02.094634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1315-9ac1-4fa7-926b-0054f794869a None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:02.096073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 733/1479] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:13:02.101656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf97a-24f8-4964-9b15-2def4f8402d2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:02.102117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf97a-24f8-4964-9b15-2def4f8402d2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:02.102250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf97a-24f8-4964-9b15-2def4f8402d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:02.120324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-64acf97a-24f8-4964-9b15-2def4f8402d2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:02.122098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-64acf97a-24f8-4964-9b15-2def4f8402d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:02.131151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 747/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:13:02.174726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1315-9ac1-4fa7-926b-0054f794869a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:02.189656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1315-9ac1-4fa7-926b-0054f794869a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:02.195391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:02.196221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:02.196520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:02.196796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:02.205344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:02.206947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc4bd-75ca-4523-8c59-86e133d426a3 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:02.216969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 734/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:04.659767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1baf-533d-4a71-8535-c6577232948c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:04.660377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1baf-533d-4a71-8535-c6577232948c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:04.660377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1baf-533d-4a71-8535-c6577232948c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:04.661630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 748/1482] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:13:04.667991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944939b8-dba8-445d-b6d5-5d52d0e78500 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:04.668630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944939b8-dba8-445d-b6d5-5d52d0e78500 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:04.668630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944939b8-dba8-445d-b6d5-5d52d0e78500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:04.686973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-944939b8-dba8-445d-b6d5-5d52d0e78500 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:04.688231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-944939b8-dba8-445d-b6d5-5d52d0e78500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:04.696536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 735/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:13:04.733222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1baf-533d-4a71-8535-c6577232948c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:04.744311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1baf-533d-4a71-8535-c6577232948c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:04.747859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:04.748542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:04.748821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:04.749089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:04.759896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:04.761535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f284-2e61-402a-9b0d-3b9ddfb1b843 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:04.771413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 749/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:07.087323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c61a0-b414-40b2-a6d4-106af3dc6435 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:07.087994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c61a0-b414-40b2-a6d4-106af3dc6435 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:07.087994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c61a0-b414-40b2-a6d4-106af3dc6435 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:07.089304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 736/1485] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:13:07.095350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e35-088a-4ea5-be86-c50784ba049f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:07.095983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e35-088a-4ea5-be86-c50784ba049f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:07.095983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e35-088a-4ea5-be86-c50784ba049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:07.114157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2a312e35-088a-4ea5-be86-c50784ba049f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:07.115361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2a312e35-088a-4ea5-be86-c50784ba049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:07.123956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 750/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:13:07.169122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c61a0-b414-40b2-a6d4-106af3dc6435 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:07.179891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c61a0-b414-40b2-a6d4-106af3dc6435 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:07.185382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:07.186096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:07.186376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:07.186647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:07.196594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:07.202794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070f62-5b89-4ae8-bfb4-36778362fdc7 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:07.208008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 737/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:09.555843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8df2-db28-4165-a4c7-f0c8da5232a9 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.556466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8df2-db28-4165-a4c7-f0c8da5232a9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.556466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8df2-db28-4165-a4c7-f0c8da5232a9 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.557804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 751/1488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:13:09.563185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385ff-01ae-4d5b-9172-2099d8918f5d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.563642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385ff-01ae-4d5b-9172-2099d8918f5d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.563748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385ff-01ae-4d5b-9172-2099d8918f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.582624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a53385ff-01ae-4d5b-9172-2099d8918f5d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:09.583827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a53385ff-01ae-4d5b-9172-2099d8918f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:09.592325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 738/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:13:09.632224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8df2-db28-4165-a4c7-f0c8da5232a9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:09.643715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8df2-db28-4165-a4c7-f0c8da5232a9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:09.647237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:09.647873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.648150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.648448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.658322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:09.659792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9defbb3-e5e1-417c-b57d-ef5870f06b05 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:09.669060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 752/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:12.635740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708061-8851-4321-9640-53fb5e823ad8 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:12.636411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708061-8851-4321-9640-53fb5e823ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:12.636411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708061-8851-4321-9640-53fb5e823ad8 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:12.637651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 739/1491] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 19 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:13:12.642983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f6eb-2af8-42ed-8718-9fc4ba1e9108 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:12.643432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f6eb-2af8-42ed-8718-9fc4ba1e9108 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:12.643539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f6eb-2af8-42ed-8718-9fc4ba1e9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:12.660732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e996f6eb-2af8-42ed-8718-9fc4ba1e9108 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:12.661898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e996f6eb-2af8-42ed-8718-9fc4ba1e9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:12.670527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 753/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 19 12:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:13:12.709959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708061-8851-4321-9640-53fb5e823ad8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:12.720694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708061-8851-4321-9640-53fb5e823ad8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:12.724311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:12.724936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:12.725211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:12.725478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:12.737227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:12.738664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9fdb-358a-4a60-a6a2-61a87850e219 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:12.748761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 740/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:22.655778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=33 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:22.743804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=33 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:06.357765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.358310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.358310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.377094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:06.378286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:06.386713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 754/1494] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:15:06.396471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.397009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.397009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.414876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:06.416069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:06.424001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 741/1495] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:15:06.428820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.438943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc5eba-6999-44e9-bb25-043159a05a2e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.443345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.443987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.444301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.444568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.445274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:15:06.446408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.447414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.447414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:15:06.447414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:15:06.448315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:06.460071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 755/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:15:06.468525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.477875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bed97-acd0-4bdd-8e07-7df36dbe4242 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.482469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.483129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.483410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.483682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.484408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.486220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.486220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:15:06.486220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:15:06.487403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:06.611262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 742/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:15:06 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:15:06.615437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.625606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9c99-d89f-42bf-b2fe-cd1a0b88c720 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.685879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.686601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.686917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.687205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.687938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.688997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.688997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:15:06.688997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:15:06.690200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:06.839137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 756/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:15:06 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:15:06.843359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.853381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a775b5-bde9-45bc-957f-1322d1bef133 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.857975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.858628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.858908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.859175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.859881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.860935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.860935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:15:06.860935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:15:06.861858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:06.874631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 743/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:15:06.878905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.889602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e7826-4959-4b87-98b8-8f570cab1374 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.894498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.895155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.895437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.895711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.896465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.897499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.897499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:15:06.897499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:15:06.898381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341cf15-911c-4828-9740-92a0b0138274 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:06.912713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 757/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:15:06.917022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:06.926989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90133bf-4698-4154-af10-322cfb60f821 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:06.932011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:06.932934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:06.933213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:06.933484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] PATH_INFO: `/v3/projects/680512b4d5344e1b86926887b92b50c2/users/59103483d0b64fce8070c787c76244b9/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:06.949423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=680512b4d5344e1b86926887b92b50c2, user_id=59103483d0b64fce8070c787c76244b9, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:06.950472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:06.950472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:15:06.950472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:15:06.952455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcb5d5-528d-4683-9d3f-3f7319b5ca8a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:07.038295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 744/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:15:06 2022] PUT /identity/v3/projects/680512b4d5344e1b86926887b92b50c2/users/59103483d0b64fce8070c787c76244b9/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:15:07.053788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfd5e-474f-46f6-8717-704da9a22420 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.054068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfd5e-474f-46f6-8717-704da9a22420 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.054344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfd5e-474f-46f6-8717-704da9a22420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.082811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e6fbfd5e-474f-46f6-8717-704da9a22420 None None] MFA Rules not processed for user `59103483d0b64fce8070c787c76244b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:07.084056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e6fbfd5e-474f-46f6-8717-704da9a22420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:07.148331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 758/1502] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:15:07.162380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963970-a07c-4f6e-9c7f-be05287a58ff None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.162795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963970-a07c-4f6e-9c7f-be05287a58ff None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.163286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963970-a07c-4f6e-9c7f-be05287a58ff None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.165767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 745/1503] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 19 12:15:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:15:07.171511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c214c01-4c15-4a4e-89dc-fa184db5c27b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.171793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c214c01-4c15-4a4e-89dc-fa184db5c27b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.172065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c214c01-4c15-4a4e-89dc-fa184db5c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.191359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2c214c01-4c15-4a4e-89dc-fa184db5c27b None None] MFA Rules not processed for user `5ab02d4594794adca8c3188d0a9d3d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:07.192608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c214c01-4c15-4a4e-89dc-fa184db5c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:07.237049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:07.245064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 759/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 19 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:15:07.253052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963970-a07c-4f6e-9c7f-be05287a58ff None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:07.264449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963970-a07c-4f6e-9c7f-be05287a58ff None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:07.267947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:07.268612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.268889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.269157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.277924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:07.279351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:07.288600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 746/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:15:07.332943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70469-e71c-4b4d-9dbd-3626a2efe95c None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.333250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70469-e71c-4b4d-9dbd-3626a2efe95c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.338496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70469-e71c-4b4d-9dbd-3626a2efe95c None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.338496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 760/1506] 10.222.0.60 () {52 vars in 829 bytes} [Thu May 19 12:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:15:07.338783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:07.412011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f53d8-64dc-4408-b90b-d04083dc514a service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:07.417270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:07.418149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.418428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.418712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] PATH_INFO: `/v3/users/59103483d0b64fce8070c787c76244b9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.420088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59103483d0b64fce8070c787c76244b9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:07.421161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:07.421161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:15:07.421161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:15:07.422372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:07.795904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59103483d0b64fce8070c787c76244b9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:07.818136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59103483d0b64fce8070c787c76244b9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:07.818764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59103483d0b64fce8070c787c76244b9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:07.819473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59103483d0b64fce8070c787c76244b9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:07.834110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59103483d0b64fce8070c787c76244b9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:07.838990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:07.907063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 747/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:15:07 2022] DELETE /identity/v3/users/59103483d0b64fce8070c787c76244b9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:15:07.911756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:07.912334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:07.912442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:07.931893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:07.934635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:07.998775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 761/1508] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:15:08.009677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:08.011326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:08.072710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4eef-5e7e-4d6a-a364-9eed1eeba444 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:08.076373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:08.077028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:08.077310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:08.077588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:08.087811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:08.089323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25461106-917b-4476-bb74-b9cca3b458c2 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:08.099126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 748/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:15:08.622987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:08.625116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:08.637762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354575-b644-4eef-87a8-d0db2b777ccd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:08.642635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:08.643524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:08.643799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:08.644072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] PATH_INFO: `/v3/projects/680512b4d5344e1b86926887b92b50c2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:08.645333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680512b4d5344e1b86926887b92b50c2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:08.646364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:08.646364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:15:08.646364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:15:08.647577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:08.811170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680512b4d5344e1b86926887b92b50c2', 'request_id': 'req-61d14166-f3dc-4f7d-83ae-78d700a4f498'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:08.872112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680512b4d5344e1b86926887b92b50c2', 'request_id': 'req-61d14166-f3dc-4f7d-83ae-78d700a4f498'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:08.887376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680512b4d5344e1b86926887b92b50c2', 'request_id': 'req-61d14166-f3dc-4f7d-83ae-78d700a4f498'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:08.899556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] The token cache is being invalidate because project 680512b4d5344e1b86926887b92b50c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:15:08.899835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:08.900518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-61d14166-f3dc-4f7d-83ae-78d700a4f498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:08.902180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 762/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:15:08 2022] DELETE /identity/v3/projects/680512b4d5344e1b86926887b92b50c2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:15:18.094651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:18.895725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:04.154384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:04.155667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:04.155667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:04.156574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:04.163112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b635-46c8-4c27-b20e-6e43f3eab753 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:04.163755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b635-46c8-4c27-b20e-6e43f3eab753 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:04.164422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b635-46c8-4c27-b20e-6e43f3eab753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:04.188646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-04e9b635-46c8-4c27-b20e-6e43f3eab753 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:04.189922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-04e9b635-46c8-4c27-b20e-6e43f3eab753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:04.259599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:04.434716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:04.436456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:04.512351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d022b-3834-4662-9cbe-cf2460577753 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:04.517777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:04.518455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:04.518733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:04.519008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:04.527566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:04.529715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c5a98-4d3b-45f8-be21-9e106a8c1be0 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:04.539150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 750/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:05.337637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9e20-55c4-4b0e-b1c9-d5fbe9b5e92e None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:05.338418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9e20-55c4-4b0e-b1c9-d5fbe9b5e92e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:05.338418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9e20-55c4-4b0e-b1c9-d5fbe9b5e92e None None] PATH_INFO: `/v3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:05.339977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 764/1514] 10.222.0.71 () {54 vars in 925 bytes} [Thu May 19 12:17:05 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:17:05.347058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0a43-643f-48d4-9bd2-50f8a80c4951 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:05.347546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0a43-643f-48d4-9bd2-50f8a80c4951 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:05.347640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0a43-643f-48d4-9bd2-50f8a80c4951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:05.369809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-df0f0a43-643f-48d4-9bd2-50f8a80c4951 None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:05.371366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-df0f0a43-643f-48d4-9bd2-50f8a80c4951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:05.460932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 751/1515] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 19 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:05.461455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0080f9a-f615-42b2-a3b0-be34e1a85d2b None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:05.461683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0080f9a-f615-42b2-a3b0-be34e1a85d2b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:05.461980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0080f9a-f615-42b2-a3b0-be34e1a85d2b None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:05.463357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:17:05.469794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110472-0bb8-4e8a-86c9-07cc4ebe8df8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:05.469794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110472-0bb8-4e8a-86c9-07cc4ebe8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:05.469794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110472-0bb8-4e8a-86c9-07cc4ebe8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:05.496170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ed110472-0bb8-4e8a-86c9-07cc4ebe8df8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:05.497449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed110472-0bb8-4e8a-86c9-07cc4ebe8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:05.505572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:05.661149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0080f9a-f615-42b2-a3b0-be34e1a85d2b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:05.675564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0080f9a-f615-42b2-a3b0-be34e1a85d2b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:05.683290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:05.683914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:05.684193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:05.684492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:05.693218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:05.694794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f850e-a143-47b8-a83e-700b56af2ec8 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:05.705017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 766/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:09.594058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2408a2-d7be-4bec-8caf-393d83b78f94 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:09.594595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2408a2-d7be-4bec-8caf-393d83b78f94 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:09.594595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2408a2-d7be-4bec-8caf-393d83b78f94 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:09.595886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 753/1519] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 19 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:17:09.601196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b67-054d-4b8a-b599-37e820ab8df1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:09.601664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b67-054d-4b8a-b599-37e820ab8df1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:09.601776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b67-054d-4b8a-b599-37e820ab8df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:09.620100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-514e0b67-054d-4b8a-b599-37e820ab8df1 None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:09.621366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-514e0b67-054d-4b8a-b599-37e820ab8df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:09.630713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 767/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 19 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:09.639159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2408a2-d7be-4bec-8caf-393d83b78f94 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:09.652781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2408a2-d7be-4bec-8caf-393d83b78f94 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:09.657712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:09.658367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:09.658643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:09.658914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:09.668013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:09.670162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371397e-a59c-4ded-9780-619d68311c3d service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:09.680710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 754/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:17.045375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145228-40e6-4289-b92d-2ff2107a6c08 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.046301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145228-40e6-4289-b92d-2ff2107a6c08 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.046301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145228-40e6-4289-b92d-2ff2107a6c08 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.047908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:17.052856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40f43-8fb5-427c-827e-10484a874082 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.053293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40f43-8fb5-427c-827e-10484a874082 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.053437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40f43-8fb5-427c-827e-10484a874082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.071197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cce40f43-8fb5-427c-827e-10484a874082 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:17.072430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cce40f43-8fb5-427c-827e-10484a874082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:17.080498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:17.236442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4145228-40e6-4289-b92d-2ff2107a6c08 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:17.251528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4145228-40e6-4289-b92d-2ff2107a6c08 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:17.256895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:17.257536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.257824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.258099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.266929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:17.268564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1620b-613b-49cd-91ad-4cb04cf71111 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:17.278608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 769/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:18.183854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30c3-ab8b-485f-8345-0838d1127c2b None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.184495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30c3-ab8b-485f-8345-0838d1127c2b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.184495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30c3-ab8b-485f-8345-0838d1127c2b None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.186451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:18.191322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e221-8604-4471-ae50-cf7b38f459a7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.191778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e221-8604-4471-ae50-cf7b38f459a7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.191937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e221-8604-4471-ae50-cf7b38f459a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.210055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8243e221-8604-4471-ae50-cf7b38f459a7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:18.211260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8243e221-8604-4471-ae50-cf7b38f459a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:18.219021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:18.370232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c30c3-ab8b-485f-8345-0838d1127c2b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.384631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c30c3-ab8b-485f-8345-0838d1127c2b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.390030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.390671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.390953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.391226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.399944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.401607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f485e92-551f-497d-af6a-8bc653ed7abe service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.411724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 757/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:22.748891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:22.749449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:22.749449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:22.750843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:22.756807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4b9-11c8-4434-a460-78388cf3415a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:22.757270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4b9-11c8-4434-a460-78388cf3415a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:22.757392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4b9-11c8-4434-a460-78388cf3415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:22.775858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cac6c4b9-11c8-4434-a460-78388cf3415a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:22.777093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cac6c4b9-11c8-4434-a460-78388cf3415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:22.785353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:22.821025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:22.822748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:22.884022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ff0b2-907c-4feb-bac9-779d34839980 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:22.888681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:22.889321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:22.889600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:22.889873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:22.898968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:22.900450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d40191-2e2e-4a15-b3f7-7f933726a2e0 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:22.909845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 772/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:25.151334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22197621-10fd-42b7-b3ea-40c678e995f0 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.151905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22197621-10fd-42b7-b3ea-40c678e995f0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.151905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22197621-10fd-42b7-b3ea-40c678e995f0 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.153295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:25.158881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157cc4a-ebf7-4ef9-90f7-3b7317b84df0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.159328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157cc4a-ebf7-4ef9-90f7-3b7317b84df0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.159441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157cc4a-ebf7-4ef9-90f7-3b7317b84df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.178367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9157cc4a-ebf7-4ef9-90f7-3b7317b84df0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:25.179632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9157cc4a-ebf7-4ef9-90f7-3b7317b84df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:25.188050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:25.225201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22197621-10fd-42b7-b3ea-40c678e995f0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:25.236381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22197621-10fd-42b7-b3ea-40c678e995f0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:25.239881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:25.240592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.240876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.241146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.251377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:25.252868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697fde-cf4e-4838-a789-ae8012df681f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:25.263266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 760/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:29.016000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:29.016574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:29.016574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:29.017979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:29.023263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5a30-c9f9-408b-9a1b-82bcf8a1ac02 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:29.023744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5a30-c9f9-408b-9a1b-82bcf8a1ac02 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:29.023857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5a30-c9f9-408b-9a1b-82bcf8a1ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:29.031093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:29.042928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a67d5a30-c9f9-408b-9a1b-82bcf8a1ac02 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:29.044124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a67d5a30-c9f9-408b-9a1b-82bcf8a1ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:29.054251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:29.331298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:29.333037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:29.338854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=75 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:29.394302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924784c-361f-44d1-8c0f-4be98254db61 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:29.397806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:29.398444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:29.398724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:29.398998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:29.408215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:29.409642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c746-8d9a-4298-bf0f-89b3f2ed8862 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:29.419475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 775/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:31.723988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:31.724588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:31.724588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:31.725964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:17:31.731436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122822-e41c-44cd-860f-e01940d204ed None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:31.731896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122822-e41c-44cd-860f-e01940d204ed None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:31.732014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122822-e41c-44cd-860f-e01940d204ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:31.750090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-83122822-e41c-44cd-860f-e01940d204ed None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:31.751289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-83122822-e41c-44cd-860f-e01940d204ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:31.759040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:32.036335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:32.038033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:32.051161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df27ab-e83e-498c-a64a-51e072dd3ad7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:32.055043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:32.055682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:32.055962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:32.056266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:32.066313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:32.067860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d242f-65da-4db4-8b40-d41e17ef3102 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:32.078168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 763/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:41.744625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=28 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:42.073150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:07.091724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.092885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.093393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.126977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.128613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.143339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 777/1540] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.153445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.154442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.154945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.181288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.183402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.192062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 764/1541] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:07.197844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.208517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d655-a381-4a45-b64f-cdc37da70869 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.222248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.223446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.223959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.224570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.225509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:07.226052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.227877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c848-4a7e-4cd5-8a2e-f14ff8bbac14 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.247020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 778/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:19:07.256142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.269976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995110f-8bf9-47b4-b4f4-364ca469b78e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.280467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.281533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.282032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.282535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.283466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.285811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.420951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a331-2499-4afc-8723-100978a8463b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.421540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a331-2499-4afc-8723-100978a8463b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.422024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a331-2499-4afc-8723-100978a8463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.452700 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ac02a331-2499-4afc-8723-100978a8463b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.454594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 765/1543] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/projects => generated 403 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:07.461352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.463328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ac02a331-2499-4afc-8723-100978a8463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.600688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45f27d-2c91-4635-ad2d-a327fd3d1e56 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.610928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.611939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.612459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.613205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.614102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.615353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:07.615353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:19:07.615353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:19:07.617252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.646596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 779/1544] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:07.657510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e6b1-f4b6-42c6-834d-df0c9811847b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.657792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e6b1-f4b6-42c6-834d-df0c9811847b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.658073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e6b1-f4b6-42c6-834d-df0c9811847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.690108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dcb8e6b1-f4b6-42c6-834d-df0c9811847b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.690108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dcb8e6b1-f4b6-42c6-834d-df0c9811847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.707603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 780/1545] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:07.708943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8307c-54b4-442d-9b4e-b897d751849c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.709234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8307c-54b4-442d-9b4e-b897d751849c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.709515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8307c-54b4-442d-9b4e-b897d751849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.717334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 766/1546] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:07.718628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.738694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0355e1-5ef5-45c1-9a15-438aeab7090d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.738885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-25d8307c-54b4-442d-9b4e-b897d751849c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.744225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-25d8307c-54b4-442d-9b4e-b897d751849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.751219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 781/1547] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.753130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368e34-2eab-41a4-b664-6a89df49f339 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.753414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368e34-2eab-41a4-b664-6a89df49f339 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.757106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368e34-2eab-41a4-b664-6a89df49f339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.757932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.758848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.759322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.759823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.760778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:07.761333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.762597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:07.762597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:19:07.762597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:19:07.764005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.780987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d6368e34-2eab-41a4-b664-6a89df49f339 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.782477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d6368e34-2eab-41a4-b664-6a89df49f339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.791585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 767/1548] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:07.795686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.799963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 782/1549] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.804354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56aed-4ddc-4480-91b5-8fb39282dbc0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.804354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56aed-4ddc-4480-91b5-8fb39282dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.804354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56aed-4ddc-4480-91b5-8fb39282dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.816254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b049-1d78-4c58-91e0-d585fdef2554 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.836446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.837589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.838665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.839197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.842317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.844452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.849342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-87c56aed-4ddc-4480-91b5-8fb39282dbc0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.852570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-87c56aed-4ddc-4480-91b5-8fb39282dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.867050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 768/1550] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:07.870401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.873891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 783/1551] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.875561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515516e5-524d-49f3-b6e7-9b2e8048eb5c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.876074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515516e5-524d-49f3-b6e7-9b2e8048eb5c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.877029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515516e5-524d-49f3-b6e7-9b2e8048eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.894329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb7c1c-cc5f-462b-9cbd-9626c1c3d140 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.907577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.909001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.912362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.912912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.913850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.916572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.918534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-515516e5-524d-49f3-b6e7-9b2e8048eb5c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.919986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-515516e5-524d-49f3-b6e7-9b2e8048eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.937006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 784/1552] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.944102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.944721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.945214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.971948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.974001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.985380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 785/1553] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.986543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.997399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7f56d-27df-4641-aa37-a54631c3baf6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.002104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.002790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.003063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.004091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.004915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.006570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.017795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 786/1554] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:08.018671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.029475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f94760-7955-424c-b285-ca76686b24e8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.034148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.034833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.035114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.035388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.036120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.036457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.038071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e8428-b5b3-47f2-92e1-25fb63fc8d67 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.051962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 787/1555] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.059594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017856-b3ee-496f-92ff-639def2f6a9d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.059594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017856-b3ee-496f-92ff-639def2f6a9d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.059594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017856-b3ee-496f-92ff-639def2f6a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.073081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-98017856-b3ee-496f-92ff-639def2f6a9d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.074314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-98017856-b3ee-496f-92ff-639def2f6a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.082762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 788/1556] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.083908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad48-a6ad-4046-8612-24d11453a421 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.084256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad48-a6ad-4046-8612-24d11453a421 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.084571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad48-a6ad-4046-8612-24d11453a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.102611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0c5dad48-a6ad-4046-8612-24d11453a421 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.104394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0c5dad48-a6ad-4046-8612-24d11453a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.112169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 789/1557] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.113374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cd1-83d7-44a0-9c89-6be401e3a23f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.113657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cd1-83d7-44a0-9c89-6be401e3a23f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.113932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cd1-83d7-44a0-9c89-6be401e3a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.131363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-de7d3cd1-83d7-44a0-9c89-6be401e3a23f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.132589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-de7d3cd1-83d7-44a0-9c89-6be401e3a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.141368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 790/1558] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.142572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.142857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.143130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.161226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.162390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.170158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 791/1559] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.171986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.180115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc825c6-1feb-42ef-b773-314370687545 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.185730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.186573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.186855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.187127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.187849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.188157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.189865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.200301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 769/1560] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/projects => generated 385 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.201022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.206931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 792/1561] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.207738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.222402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab4f8-c7d1-4712-b7e4-2919eaef9a3f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.255718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:08.265406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade956-41aa-4139-8ee3-9c4072de682f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.270049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.270952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.271230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.271502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] PATH_INFO: `/v3/projects/662bb7b650d84a89a63d4255302d1f44/users/15f01c419a114022a8497fe6f551fe5b/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.281022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.281678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.281959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.282270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.283215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.284681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:08.284681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:19:08.284681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:19:08.285897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba510f-28c1-4791-bddb-62eda329ea33 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.287056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662bb7b650d84a89a63d4255302d1f44, user_id=15f01c419a114022a8497fe6f551fe5b, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.289715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.359112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:08.364993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 770/1562] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:08 2022] PUT /identity/v3/projects/662bb7b650d84a89a63d4255302d1f44/users/15f01c419a114022a8497fe6f551fe5b/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:08.367024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.398209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 793/1563] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.398209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5cfd-8f04-4b93-a002-cd93c728948f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.398209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5cfd-8f04-4b93-a002-cd93c728948f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.398209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5cfd-8f04-4b93-a002-cd93c728948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.415589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-70ba5cfd-8f04-4b93-a002-cd93c728948f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.416818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-70ba5cfd-8f04-4b93-a002-cd93c728948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.428595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf9a57-4fcb-40e4-b5b5-119160ffe182 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.485144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.485807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.486091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.486368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.487164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.487469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.489119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc49fe-132f-41cd-a3df-f59f701af822 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.489632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 794/1564] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.490973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.491253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.491529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.502075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 771/1565] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.503408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.503700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.503971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.515351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.516579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.521319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.522469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.524301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 795/1566] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.525037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.533977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 772/1567] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.534827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.538103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d567a68-f641-4171-b47f-93d1263c0745 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.545182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.545843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.546118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.546386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.546588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38c2e-b4fb-4d4d-b268-ea3e9a63f7a3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.547063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.548999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7ae3-5755-44e7-af99-986cce02f4f9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.551071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.551709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.551986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.552280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.552955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.554846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.661315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 796/1568] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.664895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.664895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.664895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.681350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.682537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.689969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 797/1569] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:08.690716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.693792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 773/1570] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.693792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.705177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c0bb-d531-4726-9261-19d8a4bdb913 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.758996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d01c-a581-4613-9e5a-6007e2977fed admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.761461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.762128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.762410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.762682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.763364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.763740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.764492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.764780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.765055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.765309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.765774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.766108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.767684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.780250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 774/1571] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.781051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.789135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:08.793703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b82486-6868-49b1-a92a-1af1c5d4e9e3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.798275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.798915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.799198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.799474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.800171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.802108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.866736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 798/1572] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.867594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.876855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7574152-19d1-4884-9ee6-369b7b5bd71f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.881355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.881983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.882263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.882535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.883232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.883534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.885693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.898973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 799/1573] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.904124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 775/1574] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:08.904274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.904383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.909768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428e7c-ed22-4978-9210-d5c5bb1d55e6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.914693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:08.960630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60552-c180-41f5-b8e8-cb40779bc3b6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.966549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.967147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.967293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.967476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.967745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.967842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.968292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.968497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.968607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.969274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:08.969579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:08.970277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.971154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:08.980541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 776/1575] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:08.981338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.984376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 800/1576] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:08.985197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:08.993776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e48598-068b-4047-b6a7-0142b3a5b008 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:08.998415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:08.999062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.999341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.999613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.000323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.002281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.039672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594119a-2b39-4354-a820-dd75472f1620 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.043915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.047395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.047395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.047395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.054370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.055799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.066165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 801/1577] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:09.066763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.076220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b4d3-810f-4e5b-a8e8-68f3d676f691 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.080911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.081574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.081894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.082173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.082859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.084788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.101261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 777/1578] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.102231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.112874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cbd6-fb86-4afa-9534-e9a6e95a2d4b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.117358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.118075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.118350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.118619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.119911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.121527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.131906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 778/1579] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.133566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.142296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a924b4-b2ae-4558-b4b0-33cc78aacaaa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.146791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.147461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.147764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.148034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.148726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.150615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.194425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 802/1580] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.195426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.251615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 779/1581] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.251615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.264237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2184-752a-47a7-8744-ed336f9b7468 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.267572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad299-1b00-4f75-a28e-c576710614e4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.269894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.270962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.271423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.271702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.272475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.272601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.273294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.273521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.273791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.274095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.274688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.277360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.286729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 780/1582] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.287647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.299610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21c5a-0496-4f8f-a9c1-b0d0cb271e03 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.303385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.304049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.304369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.304663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.305369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.307283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.383007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 803/1583] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.384186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.396624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:09.439805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 781/1584] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.443078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.457900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa3b9b-e4ac-494c-9e05-98fe0055294f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.524450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae2c3e-1dd9-4452-a8d0-e64c7d7f7bdb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.529784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.533555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.533555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.533555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.533832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.533939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.534019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.534019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.534019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.534231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.534316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.534729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:09.535782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.546545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 782/1585] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.547312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 804/1586] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.547493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.548150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.562375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d671a5-9256-4e3a-936c-d06747f0ecaa admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.562601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23d1b-ad33-4513-8279-0185f6aaa31f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.565111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.565775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.566059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.566334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.567046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.567311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.567983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.568355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.568615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.568845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.569356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.571425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.579724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 805/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.580522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.591095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719aa5b-1bda-4b16-8108-1fff194c07ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.595692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.596597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.596900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.597176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] PATH_INFO: `/v3/projects/f62d173133b7474d8d774b8d3bdc9d83/users/366d2b2ffe384542ab49a1b9b7cc2577/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.613869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62d173133b7474d8d774b8d3bdc9d83, user_id=366d2b2ffe384542ab49a1b9b7cc2577, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.614980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:09.614980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:19:09.614980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:19:09.617035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.695831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 783/1588] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.696965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.707606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bcfe-016d-4b7a-b152-b7776537e83f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.713696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.714461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.714746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.715013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.715729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.717860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.747403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 806/1589] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:09 2022] PUT /identity/v3/projects/f62d173133b7474d8d774b8d3bdc9d83/users/366d2b2ffe384542ab49a1b9b7cc2577/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:09.748242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.813286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45131-efb0-45cc-b6d9-e90f7410dac0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.817974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.822526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.822526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.822526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.822526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.822526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.849229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 784/1590] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.850809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.865508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105830-1da6-44fd-81f2-d92c8f2a10ee admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.870264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.871173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.871486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.871824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] PATH_INFO: `/v3/projects/4322232d49414965bf03cf793e328968/users/ffca50e0b14c4bd298847c44cb7375fa/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.887313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4322232d49414965bf03cf793e328968, user_id=ffca50e0b14c4bd298847c44cb7375fa, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.889996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af61cc-9bf6-4d69-9158-27d609e50075 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.900103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 807/1591] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:09.901708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.911329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692151-b9ab-41e7-9d31-3c2ab4cc5dc7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.916023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.916705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.917018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.917527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.918189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.919773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.921127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:09.930220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 808/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.931156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.941299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63bb7a-0131-4262-94a8-e05418b291fd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.945967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:09.946607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.946902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.947704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:09.948440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:09.950030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:09.961394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 809/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:09.961825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:09.974337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c90fd-92c8-485c-bfec-24fe314ddd01 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:09.981346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 785/1594] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:09 2022] PUT /identity/v3/projects/4322232d49414965bf03cf793e328968/users/ffca50e0b14c4bd298847c44cb7375fa/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:09.982891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:09.983476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:09.983914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.021135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] MFA Rules not processed for user `366d2b2ffe384542ab49a1b9b7cc2577`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.022449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.041131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.041987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.042107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.042388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.043111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.044800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.056158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 810/1595] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.060307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.070965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60fff3-c6de-46ae-aa53-281f1e89e5a2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.077354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.078021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.078814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.079014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.079807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.081462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.092486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 811/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.093221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.102298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 786/1597] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:10.103138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.105241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae2d97-83bc-426d-9be5-aa3f7ee79720 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.111494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.112374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.112719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.113118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.117640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.117783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045e8d-9972-417b-ac0e-a6d040bc13f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.117965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.121553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.122456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.122737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.123009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] PATH_INFO: `/v3/projects/5e8854f2283343a8bef37d9dbecc987e/users/14559374caf24ddaba9c2dd1d55defe7/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.132137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 812/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.132664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.139962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8854f2283343a8bef37d9dbecc987e, user_id=14559374caf24ddaba9c2dd1d55defe7, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.142675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda771d8-c73e-43ec-a4a0-a5a9c5e2dd59 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.143886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d53bf5-b003-432d-ac19-e1366611b9b6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.148813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.150346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.150678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.150957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] PATH_INFO: `/v3/projects/44e1e4e4548e4ce9a11e07f110ec9d9f/users/cec8659660e344109a2f8618db492f46/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.165631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e1e4e4548e4ce9a11e07f110ec9d9f, user_id=cec8659660e344109a2f8618db492f46, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.168331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.214236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 787/1599] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:10 2022] PUT /identity/v3/projects/5e8854f2283343a8bef37d9dbecc987e/users/14559374caf24ddaba9c2dd1d55defe7/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:10.215559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.215845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.216119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.242840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] MFA Rules not processed for user `ffca50e0b14c4bd298847c44cb7375fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.244580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.263889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 813/1600] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:10 2022] PUT /identity/v3/projects/44e1e4e4548e4ce9a11e07f110ec9d9f/users/cec8659660e344109a2f8618db492f46/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:10.265148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.295992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:10.313861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 788/1601] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:10.314686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.336720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15f59d-1374-4fb7-9828-242bdf499328 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.343539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.344363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.344516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.345022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.345765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.347354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc9ed6-69d6-4fad-acaf-9647a6c110eb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.358329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 814/1602] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.359651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb101-d907-49aa-9ca5-4a437353c405 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.359939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb101-d907-49aa-9ca5-4a437353c405 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.360227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb101-d907-49aa-9ca5-4a437353c405 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.362083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 815/1603] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 19 12:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:10.362816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cb101-d907-49aa-9ca5-4a437353c405 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.376189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cb101-d907-49aa-9ca5-4a437353c405 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.381355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.381998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.382278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.382551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.383260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.385618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51403d-61a3-47ed-b807-24a71b188c51 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.387822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec5374-ea56-4ed5-a273-1983dab002c9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.392485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.393153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.393436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.393726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.394424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.396021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ebb58-a33f-425a-900d-adc7bbccc1a0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.396124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 816/1604] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.397719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.401422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.401422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.409678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 789/1605] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:10.409678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.409678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.409678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.417645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.418851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.428075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.430157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.432014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 817/1606] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:10.432904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.445732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 790/1607] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:10.446584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.451273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:10.456815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539cdeb-2b08-47f9-a0fd-c96983f620cd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.461619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.462510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.462842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.463114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] PATH_INFO: `/v3/projects/ca8d31da5412492d878d70be20f89da3/users/f5c9499b42124c2a9919543f866c09ac/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.480270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8d31da5412492d878d70be20f89da3, user_id=f5c9499b42124c2a9919543f866c09ac, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.482974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03344d0a-3493-4634-86d3-26cc160f9cf1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.496833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f733aa-25c9-42d8-94c9-7ec67e99de2b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.500605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.501329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.501668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.502009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.568746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.570019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 791/1608] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:10 2022] PUT /identity/v3/projects/ca8d31da5412492d878d70be20f89da3/users/f5c9499b42124c2a9919543f866c09ac/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:10.570407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.580959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 818/1609] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:10.581398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.581689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.581860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.581971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.593577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65a369-e375-4daf-8882-17670b8b6551 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.604784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.606306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.660127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.661341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.661724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.662532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] PATH_INFO: `/v3/projects/8f20a15a24c943c99e1d46a95724df89/users/dfa85b2076eb485d9926a040ce15b8c7/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.680156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20a15a24c943c99e1d46a95724df89, user_id=dfa85b2076eb485d9926a040ce15b8c7, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.683634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.693096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 792/1610] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:10.693769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.705289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea69c63-db4f-467b-8e77-40af861d0ec9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.710190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.711110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.711390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.711661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] PATH_INFO: `/v3/projects/50707617fb944f91aa21562733c82e3a/users/ea172a4b6c0c41e5b030347d234656de/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.729765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50707617fb944f91aa21562733c82e3a, user_id=ea172a4b6c0c41e5b030347d234656de, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.732991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.758407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 819/1611] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:10 2022] PUT /identity/v3/projects/8f20a15a24c943c99e1d46a95724df89/users/dfa85b2076eb485d9926a040ce15b8c7/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:10.761131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.761239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.822279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c97bc-30e7-46b5-8528-2b81baa1db9b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.825987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.826895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.827170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.827435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.831796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:10.871933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 793/1612] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:10 2022] PUT /identity/v3/projects/50707617fb944f91aa21562733c82e3a/users/ea172a4b6c0c41e5b030347d234656de/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:10.871933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:10.899711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:10.906102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:10.907546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1144bb-634e-47f9-9ba8-8b03d2793639 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:10.918684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 820/1613] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:10.921349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869fa38-88d8-4a6d-af33-ad30c670df2b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.921349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869fa38-88d8-4a6d-af33-ad30c670df2b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.921349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869fa38-88d8-4a6d-af33-ad30c670df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:10.949987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a930-2cf6-4cfa-8ca3-18915dc16a98 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:10.952067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f869fa38-88d8-4a6d-af33-ad30c670df2b None None] MFA Rules not processed for user `15f01c419a114022a8497fe6f551fe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:10.953458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f869fa38-88d8-4a6d-af33-ad30c670df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:10.954861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:10.955600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:10.955928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:10.956399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.017754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 821/1614] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:11.017973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.019306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655a29-786c-494d-9c23-6ba2c3d0182d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.019439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.019772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655a29-786c-494d-9c23-6ba2c3d0182d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.020141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e655a29-786c-494d-9c23-6ba2c3d0182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.029548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 794/1615] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:11.030738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.049762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5e655a29-786c-494d-9c23-6ba2c3d0182d None None] MFA Rules not processed for user `f5c9499b42124c2a9919543f866c09ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:11.053321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5e655a29-786c-494d-9c23-6ba2c3d0182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:11.113038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a24c-b7f3-453e-9da9-98f6858186b5 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.118983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.119750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.120035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.120338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.132037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 822/1616] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:11.136475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.136475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.136475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.166940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] MFA Rules not processed for user `dfa85b2076eb485d9926a040ce15b8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:11.168344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:11.177921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.189779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.192274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb8ab-9763-4ae7-a714-cf0f091aad7d service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.204961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 795/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:11.206786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.207080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.207352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.229186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.246001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] MFA Rules not processed for user `ea172a4b6c0c41e5b030347d234656de`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:11.248577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:11.258615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 823/1618] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:11.265743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.279666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b019df-2c58-4afc-af3a-37e5f5257a95 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.285051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.288999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.288999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.288999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.288999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.289438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.354453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 796/1619] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:11.355977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.368902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd1b11-5b0b-4bd1-a7e1-7cbfdca6da4a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.374153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.374885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.375164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.375433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.376330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.378256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.398213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 824/1620] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:11.404583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.475589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 797/1621] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:11.475589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.508315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9cc74-dfd6-4bf1-bea2-ddcf796b1016 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.576621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ab8d-6409-45a5-95cd-46dae47cf27c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.580537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.581709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.581709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.582026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.582433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.582882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.583831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.584239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.584396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.584704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.585556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.587601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.708567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 798/1622] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:11.710123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.754639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 825/1623] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/projects => generated 365 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:11.755623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:11.807582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.837523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2628997-107e-4285-a384-78c40ee82967 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.846820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:11.860309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d126eb-a9d0-4e0e-9d7f-f881a4896809 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:11.865090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.865977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.866319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.866659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.867408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.869440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987940c3-5669-4c33-a0ac-7e4e227385a6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:11.908074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:11.909107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:11.909482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:11.909822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:11.910659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:11.913471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.030223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 826/1624] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:12.030223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da32cfc-b573-42b9-ba4d-855111776e3a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.030223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da32cfc-b573-42b9-ba4d-855111776e3a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.030223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da32cfc-b573-42b9-ba4d-855111776e3a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.031256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 827/1625] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 19 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:12.033432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da32cfc-b573-42b9-ba4d-855111776e3a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.050155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da32cfc-b573-42b9-ba4d-855111776e3a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.064121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 799/1626] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:11 2022] POST /identity/v3/users => generated 308 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:12.064121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.071502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.072806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.073171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.073452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.074153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.077980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99d068-33e3-4419-803a-6e07393e89e4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.081440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce00b-522f-47d9-9963-04dfcfeb5150 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.086471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.087150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.087430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.088393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.089402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.091411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.210001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 800/1627] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:12 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:12.210978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 828/1628] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:12 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:12.215613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.215804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.215804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.215804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.222260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383a5da-bb6c-4cd7-ba3a-9f04c958568e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.227349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.228025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.228342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.228618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.229336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.231071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.235306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:12.236609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:12.252155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 801/1629] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:12.252155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.262914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bcf0-10ae-46b8-951e-71a6b7c58422 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.269583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.273026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.273026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.273026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.273026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.273397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.289393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 802/1630] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:12.290311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.310590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397cb5-ab7d-4c1a-ba44-5c5925b6a7d3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.316048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.317044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.317196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.317550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.318342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.320076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.335782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 803/1631] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:12.335782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.341826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 829/1632] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:12.345176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.347170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d5f2-5a96-4164-b0a5-945f2c0d5aa0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.354745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.356058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.356407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.356659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.357047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425ad10-2b3c-4ebb-a185-d454cb5b78c2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.357388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.359197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.361550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.362438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.362718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.362989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] PATH_INFO: `/v3/projects/a3228019f489452695105c1b22e67785/users/794da196157f4e2e984c805348b09b96/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.370467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 804/1633] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:12.371521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.382778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3228019f489452695105c1b22e67785, user_id=794da196157f4e2e984c805348b09b96, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.384146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338474d9-5529-4aba-955b-67c614c8853a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.386272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.389884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.396532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.397138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.397716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] PATH_INFO: `/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd/users/02bca3bf05c94f15a81c49462b8d2f9b/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.416953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903c03e6fbf14c42bfaecb58fdab16fd, user_id=02bca3bf05c94f15a81c49462b8d2f9b, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.419725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.558524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 830/1634] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:12 2022] PUT /identity/v3/projects/a3228019f489452695105c1b22e67785/users/794da196157f4e2e984c805348b09b96/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:12.561459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.607898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 805/1635] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:12 2022] PUT /identity/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd/users/02bca3bf05c94f15a81c49462b8d2f9b/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:12.608835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.648528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a99034-c797-4ec7-aec6-60a55bdd4d98 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.653679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:12.679534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c1d7-2d3c-42ec-9972-bf4589fec011 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.687940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.689038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.689623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.690859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.726193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.727088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.727363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.727632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] PATH_INFO: `/v3/projects/52431160dc6f469c8508e61fb9f3ec07/users/045423cbb941497e8cd27cd749452a9c/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.733344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:12.748910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52431160dc6f469c8508e61fb9f3ec07, user_id=045423cbb941497e8cd27cd749452a9c, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.753125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.782244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.783906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:12.795663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 806/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:12.796670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.825510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6aa6d-b155-46b3-94a2-fb6ceecf48bf service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.836830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 831/1637] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:12 2022] PUT /identity/v3/projects/52431160dc6f469c8508e61fb9f3ec07/users/045423cbb941497e8cd27cd749452a9c/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:12.841497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:12.983898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd55-d556-45a6-b869-2731660a6e72 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:12.989889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.990108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:12.990944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.991225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.991504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] PATH_INFO: `/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3/users/9c05d20847bf432e87ee8a45c9b66667/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.992058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:12.992672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:12.993170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:12.999849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:12.999849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ca2bd-ce99-458b-bbac-5a81c3d323a2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.014220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 832/1638] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:13.016180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.016609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.017036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.021268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819a74a50bf14385ad389ba2ee8cfaf3, user_id=9c05d20847bf432e87ee8a45c9b66667, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.024627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.049373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] MFA Rules not processed for user `14559374caf24ddaba9c2dd1d55defe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:13.050742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:13.141134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 833/1639] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:13.141940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.153204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e1473-9fa4-48d9-853e-ac582f33d5b5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.160258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 807/1640] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:12 2022] PUT /identity/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3/users/9c05d20847bf432e87ee8a45c9b66667/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:13.160258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.220456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.414111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 834/1641] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:13.423610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.426010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb31f-5175-4e85-8241-ae4f8bedb6d3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.426555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6453d-cd00-492d-83a5-6f193b850a04 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.426646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.426646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.426646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.426646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.426940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.427011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.427101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd4881-195e-40fa-ab73-91bc6d584d52 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.427173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.427173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.427173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] PATH_INFO: `/v3/projects/a3228019f489452695105c1b22e67785/users/794da196157f4e2e984c805348b09b96/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.427173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3228019f489452695105c1b22e67785, user_id=794da196157f4e2e984c805348b09b96, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.427173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 808/1642] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9797e-d527-4375-8d53-5fcd60478317 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9797e-d527-4375-8d53-5fcd60478317 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9797e-d527-4375-8d53-5fcd60478317 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 809/1643] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 19 12:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.427516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.428425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.428521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 835/1644] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:13 2022] PUT /identity/v3/projects/a3228019f489452695105c1b22e67785/users/794da196157f4e2e984c805348b09b96/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:13.428521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.428670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] MFA Rules not processed for user `14559374caf24ddaba9c2dd1d55defe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:13.428670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:13.428799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c895d2-12d7-40c2-88d1-fe1180927278 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.428799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.428799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.428799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.429189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.429189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.429189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.429521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 810/1645] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:13.429521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.429521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d0d7-045f-44ce-9a17-9840c09316a7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.429719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 836/1646] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:13.429719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.429855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.429855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.429855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.429855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] PATH_INFO: `/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd/users/02bca3bf05c94f15a81c49462b8d2f9b/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.430121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903c03e6fbf14c42bfaecb58fdab16fd, user_id=02bca3bf05c94f15a81c49462b8d2f9b, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.433540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb2d7e-a16f-429f-9d35-faf25754b8d3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.437092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971858b-c681-4569-bf97-65ee03373121 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.443752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.444618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.445084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.445283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] PATH_INFO: `/v3/projects/52431160dc6f469c8508e61fb9f3ec07/users/045423cbb941497e8cd27cd749452a9c/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.449246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=52431160dc6f469c8508e61fb9f3ec07, user_id=045423cbb941497e8cd27cd749452a9c, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.453451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfb7c5-0922-4f6e-90ae-757f3f0da9bf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.454125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 811/1647] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:13 2022] PUT /identity/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd/users/02bca3bf05c94f15a81c49462b8d2f9b/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:13.460087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.460440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.460833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.470877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 837/1648] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:13 2022] PUT /identity/v3/projects/52431160dc6f469c8508e61fb9f3ec07/users/045423cbb941497e8cd27cd749452a9c/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:13.472012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ffc5-9123-47f6-a634-d189409d8d6e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.472341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ffc5-9123-47f6-a634-d189409d8d6e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.472680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5ffc5-9123-47f6-a634-d189409d8d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.503103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:13.504375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:13.512847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d5b5ffc5-9123-47f6-a634-d189409d8d6e None None] MFA Rules not processed for user `794da196157f4e2e984c805348b09b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:13.514061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d5b5ffc5-9123-47f6-a634-d189409d8d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:13.598982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 812/1649] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 19 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:13.602782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.631220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 838/1650] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:13.632914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.633326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.637922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.671388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:13.675895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] MFA Rules not processed for user `045423cbb941497e8cd27cd749452a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:13.678444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:13.752315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f5b3-ea60-490f-bfb2-79341b3384bb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.760257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.761850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.761965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.765191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] PATH_INFO: `/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3/users/9c05d20847bf432e87ee8a45c9b66667/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.769794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819a74a50bf14385ad389ba2ee8cfaf3, user_id=9c05d20847bf432e87ee8a45c9b66667, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:13.772625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c98be0-5388-4d7d-a4bd-569677636706 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:13.799171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 813/1651] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:13 2022] PUT /identity/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3/users/9c05d20847bf432e87ee8a45c9b66667/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:13.800860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd690-0f3f-435a-a75a-417a337f82f8 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.801244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd690-0f3f-435a-a75a-417a337f82f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.801633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd690-0f3f-435a-a75a-417a337f82f8 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.817532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 814/1652] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 19 12:19:13 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:13.818811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd690-0f3f-435a-a75a-417a337f82f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.838095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 839/1653] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:13.839841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:13.858546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97fff-084c-45a7-a577-1e87710f574a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.903233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd690-0f3f-435a-a75a-417a337f82f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:13.907526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.909641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.910105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.910728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:13.946827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:13.947719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:13.948070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:13.948511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.017950 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.019406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.020338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b3fbd-f967-4026-82ff-b7648d90df1b service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.021084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b02c9e-3b60-474f-a6ed-dccaa92eb8a9 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.043261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 815/1654] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:14.045341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.045341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.045341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.052475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 840/1655] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:14.057823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.058200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.058482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.124764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] MFA Rules not processed for user `9c05d20847bf432e87ee8a45c9b66667`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:14.125993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:14.139869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:14.143658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:14.153825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 841/1656] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:14.154744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:14.173062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec31f12-e49a-439b-9096-ecd38f32df66 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:14.178721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:14.179490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.179809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.180151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.273486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 816/1657] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:14.274492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:14.285687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0ac6b-21a3-4693-b163-4a7567fbe17c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:14.293483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:14.294283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.303689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.303689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.306077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.309495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.314813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.316353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.323345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 842/1658] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:14.344318 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 817/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:14.379615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:14.392831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:14.435454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:14.445340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8afbe-0cd5-4391-8273-bc6ce4501f8e service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:14.450801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:14.451845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.452232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.452601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.462508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.464596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.480499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab61c-1d31-4ced-b9b5-587e178d9f79 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:14.485900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:14.486402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 818/1660] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:14.486674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.486956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.487228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] PATH_INFO: `/v3/users/ea172a4b6c0c41e5b030347d234656de` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.488745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea172a4b6c0c41e5b030347d234656de)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.489748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: WARNING py.warnings [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:14.489748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: warnings.warn(msg) May 19 12:19:14.489748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: May 19 12:19:14.491619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.674139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:14.684598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e016-6a41-4b28-b9a7-0ca7221392d2 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:14.688669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:14.689438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.689859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.690200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.735577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea172a4b6c0c41e5b030347d234656de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:14.771945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea172a4b6c0c41e5b030347d234656de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:14.791984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea172a4b6c0c41e5b030347d234656de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:14.793871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea172a4b6c0c41e5b030347d234656de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:14.794626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a0ba84b-214b-4a1f-95ec-030e9f1f4c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea172a4b6c0c41e5b030347d234656de'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:14.797485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:14.802641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc003-40fe-4065-aa7c-15144373ad23 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:14.831866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 819/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:14.910569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32aef-a9c4-440c-b756-1f4f1f5463a3 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.910997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32aef-a9c4-440c-b756-1f4f1f5463a3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.911379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32aef-a9c4-440c-b756-1f4f1f5463a3 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.913479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 820/1662] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 19 12:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:19:14.923750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.924543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.925086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.942890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 843/1663] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:14 2022] DELETE /identity/v3/users/ea172a4b6c0c41e5b030347d234656de => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:14.947939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:14.949505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:14.949874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:14.985284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:14.986478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:15.078541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:15.081092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:15.104300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 844/1664] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:15.114859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:15.119432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:15.158548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 821/1665] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:15.225840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27348631-9a19-42a9-aae6-5d06035339a9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:15.229505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:15.230917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:15.234201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:15.234201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:15.234201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:15.234201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:15.251042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9477ca-6120-4f9f-81bc-f11561764478 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:15.254319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:15.255147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eee83-84ad-4687-a854-08670484648d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:15.255800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eee83-84ad-4687-a854-08670484648d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:15.256078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eee83-84ad-4687-a854-08670484648d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:15.256374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d06da-12ba-4e16-8b03-167c0abe455a service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:15.256474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eee83-84ad-4687-a854-08670484648d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:15.271561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eee83-84ad-4687-a854-08670484648d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:15.273045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eee83-84ad-4687-a854-08670484648d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:15.286649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 845/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:15.303957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 822/1667] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:15.617211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:15.942974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:16.141657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1acb56-beb4-40cf-b386-e2bfc928cf54 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.142339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1acb56-beb4-40cf-b386-e2bfc928cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.142917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1acb56-beb4-40cf-b386-e2bfc928cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.183212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0a1acb56-beb4-40cf-b386-e2bfc928cf54 None None] MFA Rules not processed for user `02bca3bf05c94f15a81c49462b8d2f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:16.184651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0a1acb56-beb4-40cf-b386-e2bfc928cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.261294 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 846/1668] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:16.319275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eee83-84ad-4687-a854-08670484648d service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:16.320885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-039eee83-84ad-4687-a854-08670484648d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.349812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eee83-84ad-4687-a854-08670484648d service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:16.377091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:16.378218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.379498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.382079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] PATH_INFO: `/v3/projects/50707617fb944f91aa21562733c82e3a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.394102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50707617fb944f91aa21562733c82e3a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:16.397313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: WARNING py.warnings [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:19:16.397313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: warnings.warn(msg) May 19 12:19:16.397313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: May 19 12:19:16.405752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:16.447833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9f481-b662-4d23-8ad4-971343d7f65a None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.448119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9f481-b662-4d23-8ad4-971343d7f65a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.448409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9f481-b662-4d23-8ad4-971343d7f65a None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.450055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 847/1669] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 19 12:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:16.455564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.455845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.456120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.482874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] MFA Rules not processed for user `56883af2bfba4a12b2642987506a187e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:16.484396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.601663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 848/1670] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 19 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:16.611099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:16.629463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917746a1-748c-44cf-9800-2e246ea0f32f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:16.638481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50707617fb944f91aa21562733c82e3a', 'request_id': 'req-acf318e9-2f44-4091-98d5-2598cca08181'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:16.715964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50707617fb944f91aa21562733c82e3a', 'request_id': 'req-acf318e9-2f44-4091-98d5-2598cca08181'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:16.774738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50707617fb944f91aa21562733c82e3a', 'request_id': 'req-acf318e9-2f44-4091-98d5-2598cca08181'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:16.805349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] The token cache is being invalidate because project 50707617fb944f91aa21562733c82e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:16.805646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:16.807163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:16.816080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 823/1671] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:16 2022] DELETE /identity/v3/projects/50707617fb944f91aa21562733c82e3a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:16.818828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:16.821071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.919715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:16.920428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.920702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.920983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.922890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.935586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:16.937606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:16.955558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 849/1672] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:16.957843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:16.960826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.974436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e9-2f44-4091-98d5-2598cca08181 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:17.000780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5a2a-9013-4968-b818-db0f1e1e99db service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:17.008292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:17.010053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:17.010335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:17.010602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] PATH_INFO: `/v3/users/dfa85b2076eb485d9926a040ce15b8c7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:17.012549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa85b2076eb485d9926a040ce15b8c7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:17.014721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:17.021516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:17.023585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:17.031930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:17.033731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] PATH_INFO: `/v3/users/045423cbb941497e8cd27cd749452a9c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:17.038194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045423cbb941497e8cd27cd749452a9c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:17.043648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:17.062749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:17.248678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa85b2076eb485d9926a040ce15b8c7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.264032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa85b2076eb485d9926a040ce15b8c7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.275083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa85b2076eb485d9926a040ce15b8c7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.276908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa85b2076eb485d9926a040ce15b8c7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.278895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9928be2a-538a-4bbb-a7c9-cfdfbefe818d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa85b2076eb485d9926a040ce15b8c7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.368884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045423cbb941497e8cd27cd749452a9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.392054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 850/1673] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:16 2022] DELETE /identity/v3/users/dfa85b2076eb485d9926a040ce15b8c7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:17.394368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:17.394929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:17.395407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:17.398790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045423cbb941497e8cd27cd749452a9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.401366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045423cbb941497e8cd27cd749452a9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.402293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045423cbb941497e8cd27cd749452a9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.419475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045423cbb941497e8cd27cd749452a9c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:17.425693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:17.427519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:17.515210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 851/1674] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:17.524163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 824/1675] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:16 2022] DELETE /identity/v3/users/045423cbb941497e8cd27cd749452a9c => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:17.536405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:17.538063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:17.681993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15afa5-7397-4216-822a-1fd0155f6838 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:17.769606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:17.770363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:17.770749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:17.771160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:17.789728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:17.854266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:17.856015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce73b-2947-4b2a-b9a6-d3b7c0c9ee8d service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:17.869797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 852/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:18.226185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:18.475695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:18.477334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:18.495894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3135-8c17-45bb-8d48-ec3d2fc16891 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:18.502487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:18.503649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:18.504102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:18.504857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] PATH_INFO: `/v3/projects/52431160dc6f469c8508e61fb9f3ec07` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:18.506804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52431160dc6f469c8508e61fb9f3ec07)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:18.509122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:18.667038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52431160dc6f469c8508e61fb9f3ec07', 'request_id': 'req-4adf3e8f-f225-42c0-a890-7397f70d5b7e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:18.779366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52431160dc6f469c8508e61fb9f3ec07', 'request_id': 'req-4adf3e8f-f225-42c0-a890-7397f70d5b7e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:18.782826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52431160dc6f469c8508e61fb9f3ec07', 'request_id': 'req-4adf3e8f-f225-42c0-a890-7397f70d5b7e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:18.798776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:18.810209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] The token cache is being invalidate because project 52431160dc6f469c8508e61fb9f3ec07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:18.810209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:18.810604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:18.814531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 825/1677] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:18 2022] DELETE /identity/v3/projects/52431160dc6f469c8508e61fb9f3ec07 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:18.819204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180d65-32d4-490f-907a-235166c1a9d7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:18.819751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180d65-32d4-490f-907a-235166c1a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:18.819834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180d65-32d4-490f-907a-235166c1a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:18.858416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cd180d65-32d4-490f-907a-235166c1a9d7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:18.859719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cd180d65-32d4-490f-907a-235166c1a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:18.880644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:18.882583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:19.113510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3e8f-f225-42c0-a890-7397f70d5b7e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.127181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.128492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.128978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.133053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] PATH_INFO: `/v3/projects/8f20a15a24c943c99e1d46a95724df89` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.133053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f20a15a24c943c99e1d46a95724df89)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.142105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.143767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 853/1678] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:19.161121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.161903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.162332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.208886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:19.211458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:19.225543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 854/1679] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:19.229554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.252455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b818-bfbd-47d1-a5f9-83818b3c6674 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.267105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.267788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.268069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.268679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.269634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:19.269944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.271549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.301560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 855/1680] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:19.309463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.327059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8883-7caa-46b5-832e-82554e2c337c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.342727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f20a15a24c943c99e1d46a95724df89', 'request_id': 'req-49ef9237-1b11-4ada-9fb2-03eebfccac36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.425976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.426969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.434031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.439591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.441324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.446305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.468881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f20a15a24c943c99e1d46a95724df89', 'request_id': 'req-49ef9237-1b11-4ada-9fb2-03eebfccac36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.479846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f20a15a24c943c99e1d46a95724df89', 'request_id': 'req-49ef9237-1b11-4ada-9fb2-03eebfccac36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.492102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] The token cache is being invalidate because project 8f20a15a24c943c99e1d46a95724df89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:19.492436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.493294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.503617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 826/1681] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:18 2022] DELETE /identity/v3/projects/8f20a15a24c943c99e1d46a95724df89 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:19.508001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.510722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:19.527552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9237-1b11-4ada-9fb2-03eebfccac36 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.532901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.533795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.534093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.534555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] PATH_INFO: `/v3/users/9c05d20847bf432e87ee8a45c9b66667` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.536085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c05d20847bf432e87ee8a45c9b66667)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.538203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.576247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 856/1682] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:19 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:19.580525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.582746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:19.688493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c886-59d5-491b-86b4-ae93e3644423 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.693939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.695032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.695389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.695869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.696815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.699191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.769795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 857/1683] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:19 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:19.774485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.787466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c05d20847bf432e87ee8a45c9b66667'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.791791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d568-b638-46bf-ac4c-aff7bf3c67f4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.798151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.799118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.799580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.799987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.801355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.804098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.824183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c05d20847bf432e87ee8a45c9b66667'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.825387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c05d20847bf432e87ee8a45c9b66667'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.825898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 858/1684] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:19.827732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c05d20847bf432e87ee8a45c9b66667'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.845420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.852674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:19.881773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f49c8a4b-2893-4bf8-8d7a-b43273466d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c05d20847bf432e87ee8a45c9b66667'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:19.901289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea020-388c-4c30-b9c5-0641ebb96c6a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:19.908672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:19.909364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:19.909681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:19.913932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:19.916428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:19.920270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:19.945336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 859/1685] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:19.964078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:19.985680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7fc1-dcf4-438c-90f6-db6ee9c0e1f7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:20.000615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:20.012797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:20.013094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:20.013380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] PATH_INFO: `/v3/projects/e2d9e24aba1d478c8bb53220d6e511d3/users/8d132492f1f2465eaf68163584c6ae91/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:20.018337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 827/1686] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:19 2022] DELETE /identity/v3/users/9c05d20847bf432e87ee8a45c9b66667 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:20.087223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d9e24aba1d478c8bb53220d6e511d3, user_id=8d132492f1f2465eaf68163584c6ae91, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:20.094355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:20.199889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 860/1687] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:19 2022] PUT /identity/v3/projects/e2d9e24aba1d478c8bb53220d6e511d3/users/8d132492f1f2465eaf68163584c6ae91/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:20.213580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:20.214623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:20.215109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:20.241729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:20.245616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:20.291587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] MFA Rules not processed for user `8d132492f1f2465eaf68163584c6ae91`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:20.294770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:20.390855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d7afd-ef51-4240-b7da-3e26f0bd05c2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:20.419344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:20.422003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:20.426516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:20.427478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] PATH_INFO: `/v3/users/15f01c419a114022a8497fe6f551fe5b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:20.435359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f01c419a114022a8497fe6f551fe5b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:20.439328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:20.443830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 828/1688] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:20.443943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:20.482128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05c3a8-bcc3-4b18-99d3-b867d6985465 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:20.497089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:20.497982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:20.498339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:20.498735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:20.501713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:20.503924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:20.677545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 829/1689] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:20 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:20.681005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:20.782349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f01c419a114022a8497fe6f551fe5b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:20.808067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f01c419a114022a8497fe6f551fe5b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:20.824009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f01c419a114022a8497fe6f551fe5b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:20.825367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f01c419a114022a8497fe6f551fe5b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:20.826842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f01c419a114022a8497fe6f551fe5b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:20.858429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff8d2-7500-4ac3-8d14-5d32fbb4c229 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:20.863958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:20.865165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:20.865506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:20.865787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:20.866476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:20.868467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:20.924533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 861/1690] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:20 2022] DELETE /identity/v3/users/15f01c419a114022a8497fe6f551fe5b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:20.926171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:20.935717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:20.971014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 830/1691] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:20 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:20.982181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:20.984003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:21.022687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c5a3-2719-433e-905c-f6dd951b052f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:21.093744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:21.146803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:21.148981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.149423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.149843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.151444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:21.157465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:21.164405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfba0e-4294-4f42-a845-823f7fcf1087 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:21.176414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:21.177621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.179094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.179830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] PATH_INFO: `/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.182662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819a74a50bf14385ad389ba2ee8cfaf3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:21.184082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 831/1692] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:21.185132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:21.185322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:21.187051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:21.216708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c6c-9139-4e68-b139-c3dcb985f847 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:21.223650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:21.224871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.225291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.225709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] PATH_INFO: `/v3/users/366d2b2ffe384542ab49a1b9b7cc2577` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.227262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] RBAC: Authorizing `identity:delete_user(user_id=366d2b2ffe384542ab49a1b9b7cc2577)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:21.230772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:21.414199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819a74a50bf14385ad389ba2ee8cfaf3', 'request_id': 'req-aea36872-e5e4-4638-9ecf-a5b60b3b5322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.546783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819a74a50bf14385ad389ba2ee8cfaf3', 'request_id': 'req-aea36872-e5e4-4638-9ecf-a5b60b3b5322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.556760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819a74a50bf14385ad389ba2ee8cfaf3', 'request_id': 'req-aea36872-e5e4-4638-9ecf-a5b60b3b5322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.565753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366d2b2ffe384542ab49a1b9b7cc2577'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.573512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] The token cache is being invalidate because project 819a74a50bf14385ad389ba2ee8cfaf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:21.574465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.575331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.579796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 862/1693] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:20 2022] DELETE /identity/v3/projects/819a74a50bf14385ad389ba2ee8cfaf3 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:21.581220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:21.583070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:21.622817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366d2b2ffe384542ab49a1b9b7cc2577'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.623906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366d2b2ffe384542ab49a1b9b7cc2577'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.624889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366d2b2ffe384542ab49a1b9b7cc2577'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.635544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ddc25f1f-b4b0-4451-bf96-e61eb17b48da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366d2b2ffe384542ab49a1b9b7cc2577'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:21.696732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:21.700430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36872-e5e4-4638-9ecf-a5b60b3b5322 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:21.707978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:21.709675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.709675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.710033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] PATH_INFO: `/v3/projects/09b20b842ff443e08d41b978ecd260a8/users/fa1950397bd9421daec3cc406ee05335/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.758580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b20b842ff443e08d41b978ecd260a8, user_id=fa1950397bd9421daec3cc406ee05335, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:21.761362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b9622-7b7d-4d4f-a5c4-f93f9a574dfa admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:21.781578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 832/1694] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:21 2022] DELETE /identity/v3/users/366d2b2ffe384542ab49a1b9b7cc2577 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:21.782978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.783270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.783706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.845564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] MFA Rules not processed for user `cec8659660e344109a2f8618db492f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:21.846931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:21.897911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 863/1695] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:21 2022] PUT /identity/v3/projects/09b20b842ff443e08d41b978ecd260a8/users/fa1950397bd9421daec3cc406ee05335/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:21.902322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1af9-f62b-47b6-b351-98fe2dba9c32 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:21.902911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1af9-f62b-47b6-b351-98fe2dba9c32 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:21.903385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1af9-f62b-47b6-b351-98fe2dba9c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:21.940255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 833/1696] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:21.940255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:21.940255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:21.953720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2f7e1af9-f62b-47b6-b351-98fe2dba9c32 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:21.954882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2f7e1af9-f62b-47b6-b351-98fe2dba9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.036448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d7b7b-4bc1-42ba-924b-060a801f6bb8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.048828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:22.049003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 864/1697] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:22.051678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.051678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.051909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.077861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:22.079086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.094360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 865/1698] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:22.095276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.098854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.129344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.130721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.130836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.131145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] PATH_INFO: `/v3/projects/662bb7b650d84a89a63d4255302d1f44` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.131905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6962-6a8c-42dc-994f-b8b519e22e7a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.132555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662bb7b650d84a89a63d4255302d1f44)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.135713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.138449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.150102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.150102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.150102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.150102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.150102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.153987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 866/1699] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:22.159269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.161440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.253742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091061-553a-4835-9661-ed171d8d0a5d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.260492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.261249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.262192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.262435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.311354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662bb7b650d84a89a63d4255302d1f44', 'request_id': 'req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:22.369442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.371111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e664e5-9325-430c-8dda-b743e51ab200 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.381356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 867/1700] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:22.392843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.393255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.393638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.427081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662bb7b650d84a89a63d4255302d1f44', 'request_id': 'req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:22.437479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662bb7b650d84a89a63d4255302d1f44', 'request_id': 'req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:22.449693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:22.456927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.470090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] The token cache is being invalidate because project 662bb7b650d84a89a63d4255302d1f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:22.470423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:22.471211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:22.473292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 834/1701] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:21 2022] DELETE /identity/v3/projects/662bb7b650d84a89a63d4255302d1f44 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:22.474081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.480185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.571353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 868/1702] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:22.574443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.577690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab35a8-f40d-4d7b-860e-d13d8aea02a4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.579003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.581946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.582783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.583092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.583372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.585767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.603189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.605083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61471f-b755-4fea-ba63-af65e6469e54 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.611563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d49e1-46e3-4ef6-a944-097994085109 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.617132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.618416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 835/1703] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:22.618526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.618526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.618879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] PATH_INFO: `/v3/projects/09b20b842ff443e08d41b978ecd260a8/users/fa1950397bd9421daec3cc406ee05335/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.619819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.620332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.620749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.621548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b20b842ff443e08d41b978ecd260a8, user_id=fa1950397bd9421daec3cc406ee05335, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.626070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.640576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 869/1704] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:22 2022] PUT /identity/v3/projects/09b20b842ff443e08d41b978ecd260a8/users/fa1950397bd9421daec3cc406ee05335/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:22.641503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.645443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:22.646938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.648107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:22.726952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 836/1705] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:22.727509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:22.800475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93bc4-4e7c-4ada-a9a7-ad1711f2c982 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.814148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.815130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.815439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.815720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] PATH_INFO: `/v3/users/02bca3bf05c94f15a81c49462b8d2f9b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.818768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936125e-95d2-485d-bb1e-45832bb60994 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:22.819271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bca3bf05c94f15a81c49462b8d2f9b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.821895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.824867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:22.825971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.826275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.826550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.827592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:22.828645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:22.831171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8d00-f779-4f54-b110-be174f0ebc9b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:22.851749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 837/1706] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:22.855070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:22.855367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:22.855646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:22.905736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] MFA Rules not processed for user `fa1950397bd9421daec3cc406ee05335`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:22.907434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.047723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 838/1707] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:23.051115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.089346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6055a8-aa2a-4c5e-b2d8-a8db926c02a7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:23.113187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:23.115850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.117683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.119879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.120992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:23.125873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:23.132282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bca3bf05c94f15a81c49462b8d2f9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:23.188234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bca3bf05c94f15a81c49462b8d2f9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:23.208922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bca3bf05c94f15a81c49462b8d2f9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:23.222929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bca3bf05c94f15a81c49462b8d2f9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:23.222929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bca3bf05c94f15a81c49462b8d2f9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:23.289033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 839/1708] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:23 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:23.290888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.293106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.370319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 870/1709] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:22 2022] DELETE /identity/v3/users/02bca3bf05c94f15a81c49462b8d2f9b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:23.371269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.381405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.387060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7ed4-7e20-43ad-b35d-d0a958b11260 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:23.473935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:23.474611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.480915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.480915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.481534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.506731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a7c1-fb6e-4512-9cde-11cbcbf3e3f5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:23.518427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:23.519646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.520002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.520468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.524767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.575104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:23.577495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:23.626335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 840/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:23.627453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.631838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.636532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:23.640647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a5fcb-2822-4c2f-bdfa-7dab4103a613 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:23.652825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 871/1711] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:19:23.655476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.656256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.657300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.698322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:23.699113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.855259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77af4b2-80a0-41f4-a27d-c263ce9dccc8 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:23.866259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:23.867173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.868191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.869291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.870099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:23.875365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:23.904296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 872/1712] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:23.905801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.907720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:23.953640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea512c3-0db5-4e8c-8d80-0040d56aaa8f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:23.968588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:23.970062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:23.970524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:23.970969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] PATH_INFO: `/v3/projects/f62d173133b7474d8d774b8d3bdc9d83` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:23.972831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62d173133b7474d8d774b8d3bdc9d83)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:23.975782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:23.979409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 841/1713] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:23 2022] POST /identity/v3/users => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:23.981666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:23.985921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.031825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3108-156c-49f4-84e9-a596188d3238 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:24.040344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:24.041671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:24.042382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:24.042975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] PATH_INFO: `/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:24.047410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] RBAC: Authorizing `identity:delete_project(project_id=903c03e6fbf14c42bfaecb58fdab16fd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:24.049960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:24.176527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62d173133b7474d8d774b8d3bdc9d83', 'request_id': 'req-3137c225-ea45-4d1e-96a6-5a09dbbf558c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.191034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:24.267966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903c03e6fbf14c42bfaecb58fdab16fd', 'request_id': 'req-3b9a31f6-63ad-4224-a137-4842fb33eace'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.328923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62d173133b7474d8d774b8d3bdc9d83', 'request_id': 'req-3137c225-ea45-4d1e-96a6-5a09dbbf558c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.355834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62d173133b7474d8d774b8d3bdc9d83', 'request_id': 'req-3137c225-ea45-4d1e-96a6-5a09dbbf558c'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.392098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] The token cache is being invalidate because project f62d173133b7474d8d774b8d3bdc9d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:24.393320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.396344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.399080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 873/1714] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:23 2022] DELETE /identity/v3/projects/f62d173133b7474d8d774b8d3bdc9d83 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:24.405537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:24.410308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.426342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:24.478986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903c03e6fbf14c42bfaecb58fdab16fd', 'request_id': 'req-3b9a31f6-63ad-4224-a137-4842fb33eace'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.489385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903c03e6fbf14c42bfaecb58fdab16fd', 'request_id': 'req-3b9a31f6-63ad-4224-a137-4842fb33eace'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.530931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] The token cache is being invalidate because project 903c03e6fbf14c42bfaecb58fdab16fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:24.531233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.531989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:24.534939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 842/1715] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:23 2022] DELETE /identity/v3/projects/903c03e6fbf14c42bfaecb58fdab16fd => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:24.535753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:24.537375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.607133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c225-ea45-4d1e-96a6-5a09dbbf558c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:24.658673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a31f6-63ad-4224-a137-4842fb33eace admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:24.671865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:24.671865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:24.671865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:24.671865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:24.672379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.714328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:24.716488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:24.731175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:24.731885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:24.732287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:24.733922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:24.737061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.747888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 843/1716] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:24.747888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:24.751367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:24.849844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:24.912764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:24.917708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478b41-3861-41a4-85d5-9331f8220432 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:24.940739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 874/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:24.947431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e99a3-5a01-4264-969c-a868b2dd3786 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:24.947766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e99a3-5a01-4264-969c-a868b2dd3786 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:24.948077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e99a3-5a01-4264-969c-a868b2dd3786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.111673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-011e99a3-5a01-4264-969c-a868b2dd3786 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:25.111673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-011e99a3-5a01-4264-969c-a868b2dd3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.112315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c887d-a521-4c57-9069-de54d86bcd1f service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.112511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 875/1718] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:25.112511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.112511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.112511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.113029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.113029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.113029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.113029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.113508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.113508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913f7fd-1aa2-460c-9a4f-5bf39e89ba7a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.113508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 844/1719] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:25.113508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.113508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.119304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.121295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:25.122640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.151909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 876/1720] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:25.152955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.176025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6495204-5d82-42d3-bfb6-88d3a29b5972 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.189002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:25.190962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.199643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.201375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.202160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.205302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 845/1721] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:25.209250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.211295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.213555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.214122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.218040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb24d8e-0e1e-41e8-a752-07224742e7a9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.229017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc41e8-e315-476d-8c5a-8b1890158e63 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.236135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.238140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.238611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.239064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] PATH_INFO: `/v3/users/ffca50e0b14c4bd298847c44cb7375fa` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.240737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffca50e0b14c4bd298847c44cb7375fa)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.244691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.258466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 877/1722] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:25.260614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.260825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.261699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.295866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:25.297897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.312362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 878/1723] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:25.327950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.330892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52902f5-3c32-4e36-989f-3bd2d8d630de None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.348596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.349777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.350215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.350652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.351664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:25.352133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.354863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.396255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 879/1724] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:25.397023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.412776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c021c7-6c59-4282-9d5c-29ed654e9e61 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.420280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.421443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.426448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.426448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] PATH_INFO: `/v3/projects/7db5f58131c44809999487ba1614722c/users/fdfa10a0565046e0999bc05f8ab06bf9/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.489096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db5f58131c44809999487ba1614722c, user_id=fdfa10a0565046e0999bc05f8ab06bf9, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.498244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.640060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 880/1725] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:25 2022] PUT /identity/v3/projects/7db5f58131c44809999487ba1614722c/users/fdfa10a0565046e0999bc05f8ab06bf9/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:25.640060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.654007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffca50e0b14c4bd298847c44cb7375fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:25.686700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffca50e0b14c4bd298847c44cb7375fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:25.693119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffca50e0b14c4bd298847c44cb7375fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:25.696435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffca50e0b14c4bd298847c44cb7375fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:25.704868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffca50e0b14c4bd298847c44cb7375fa'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:25.790659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bf39-9f8b-4335-8194-df68d45ceef4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:25.810456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:25.811188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.811476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.811753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.812531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:25.812843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:25.815198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ef78-e8ff-45d4-9db5-ba27eba198f1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:25.849081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 846/1726] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:25 2022] DELETE /identity/v3/users/ffca50e0b14c4bd298847c44cb7375fa => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:25.849081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:25.850654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:25.881193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 881/1727] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:25.883681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d87aca-8ead-4d71-ac9f-4245937c71c8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:25.884018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d87aca-8ead-4d71-ac9f-4245937c71c8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:25.884651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d87aca-8ead-4d71-ac9f-4245937c71c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:25.964154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-80d87aca-8ead-4d71-ac9f-4245937c71c8 None None] MFA Rules not processed for user `fdfa10a0565046e0999bc05f8ab06bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:25.967162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-80d87aca-8ead-4d71-ac9f-4245937c71c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:26.017140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e397-8ea4-43d8-8bd7-365ce4e1bcd0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:26.042947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:26.044045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:26.045688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:26.050134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:26.050134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:26.050791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:26.161792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 882/1728] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:26.167296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:26.168717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:26.169510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:26.182754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 847/1729] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:25 2022] POST /identity/v3/projects => generated 371 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:26.182754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:26.187264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:26.210860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:26.214612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:26.369866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 883/1730] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:26.374639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:26.378535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:26.395295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395fec-f697-432a-be1f-f23b593ad5f3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:26.406384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f873af0-793f-4be1-aa8b-1a61e9287400 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:26.422229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:26.427730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:26.428129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:26.428486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:26.431325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:26.431487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:26.431487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:26.431487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:26.431487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:26.432181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:26.434490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:26.440178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:26.542706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:26.615106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 884/1731] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:26 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:26.616524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:26.623727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 848/1732] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:26 2022] POST /identity/v3/projects => generated 367 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:26.625060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:26.628673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:26.629280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:26.733870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28264-1917-4384-a897-65e9b1023063 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:26.745985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:26.746927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:26.747251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:26.747594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:26.806471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926eeb3-22b8-4e6d-bd5d-aa485021827b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:26.927096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:26.931855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:26.995156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 849/1733] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:27.004305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.029331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.031353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.031835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.032371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.036540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.048896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943da73-d0ac-42ba-abf7-c8d5ab9810e6 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.055052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb4900-b437-4260-814c-03f333a5c5a9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.066625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.067597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.067720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.067978 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.068765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.075368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.228551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 850/1734] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:26 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:27.229512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.238016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 885/1735] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:26 2022] POST /identity/v3/users => generated 286 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:27.241026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fcd2-e262-46fd-80da-7d18d461f71f None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.246743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fcd2-e262-46fd-80da-7d18d461f71f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.247250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fcd2-e262-46fd-80da-7d18d461f71f None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.256846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 886/1736] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:19:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:27.256846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6fcd2-e262-46fd-80da-7d18d461f71f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.270413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea538-fe7d-4bc2-8a61-989b04973017 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.282612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.303777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.303777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.303777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.303777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.303777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb733b-ae7b-4966-a78e-192887bd039b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.318353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6fcd2-e262-46fd-80da-7d18d461f71f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.331624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.332614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.333046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.333630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.335193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.352594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.375057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 887/1737] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:27.376194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.400515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11108a-0a31-477d-a9b5-17f3b7d3a3ba admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.408624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.410062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.411030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.411664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.412732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.415537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.447496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 851/1738] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:27 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:27.457269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.457773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.458057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.459621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 888/1739] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:27.460873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.522390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dd37-493b-4d1a-aa71-e2b6c056cf61 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.551480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.552407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.552692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.557030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] PATH_INFO: `/v3/projects/ea9f604cffb4498fae533af7fa861520/users/41e080abf81d4820ab3c0aef4b89b322/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.567268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:27.568518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:27.642629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9f604cffb4498fae533af7fa861520, user_id=41e080abf81d4820ab3c0aef4b89b322, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.647213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580741-7db5-4ce7-b66a-dc48b953e122 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.754007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 852/1740] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:27.754787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.779608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07300e6-9169-4fc3-a734-d86e09eda0a9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.784664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.785556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.785786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.786038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.786793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.788422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.804138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 853/1741] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:27.804138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.815322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 889/1742] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:27 2022] PUT /identity/v3/projects/ea9f604cffb4498fae533af7fa861520/users/41e080abf81d4820ab3c0aef4b89b322/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:27.822632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.822632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.822632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.828773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc21d2-eb92-4e9b-88d9-a462a45521b2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.844921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] MFA Rules not processed for user `cec8659660e344109a2f8618db492f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:27.846282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:27.909973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.910900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.911231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.911525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:27.912356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:27.914641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:27.936770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 854/1743] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:27.937735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.940415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:27.970110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 890/1744] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:27.971153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:27.986038 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0f9d-3454-4204-b05a-449767f2c757 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:27.992292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:27.994295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:27.994717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:27.995134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] PATH_INFO: `/v3/projects/00e1155eea8d4ab68ef64aad32487694/users/c302d0e82dae4f60bcd0ccb8ac550076/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.015834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e1155eea8d4ab68ef64aad32487694, user_id=c302d0e82dae4f60bcd0ccb8ac550076, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.018803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.113047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 891/1745] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:27 2022] PUT /identity/v3/projects/00e1155eea8d4ab68ef64aad32487694/users/c302d0e82dae4f60bcd0ccb8ac550076/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:28.118071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:28.188802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604dd1-f510-4747-82d7-0ef08765b70e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.302170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1078-fdc4-4117-89de-5deeaca17d28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.317963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.317963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.317963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.317963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.318377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.318377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.346850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 892/1746] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:28.346850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:28.386389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195284f-671c-4cc7-a8dc-45bbdd55a6fe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.427464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.427464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.427464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.427464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5432b-4aa4-49be-ac5c-4523e45cf053 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 893/1747] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.427750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.459860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.460615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.460898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.461175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.483274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.491199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.499918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] MFA Rules not processed for user `c302d0e82dae4f60bcd0ccb8ac550076`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:28.502201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:28.528078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 855/1748] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:28.530835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:28.583141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9db9-fd25-40d1-9e5d-3d3929190fdd service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.606002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.610380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.610685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.611956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] PATH_INFO: `/v3/projects/ea9f604cffb4498fae533af7fa861520/users/41e080abf81d4820ab3c0aef4b89b322/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.628780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9f604cffb4498fae533af7fa861520, user_id=41e080abf81d4820ab3c0aef4b89b322, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.642011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.675939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 856/1749] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:28 2022] PUT /identity/v3/projects/ea9f604cffb4498fae533af7fa861520/users/41e080abf81d4820ab3c0aef4b89b322/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:28.677644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:28.691816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 894/1750] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:28.696222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:28.703253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:28.730631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8fba1-dc29-4f37-9bd9-58fbc5eecc38 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.859238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d47e-f852-4dc6-95f3-52d919309807 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:28.866612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.867804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.868289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.871278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] PATH_INFO: `/v3/projects/8372cef3efcb462a8c0217409cc2d782/users/6f96a0de028a496191db23622f830ac2/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.882960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:28.884149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:28.884611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:28.885056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] PATH_INFO: `/v3/projects/4322232d49414965bf03cf793e328968` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:28.886558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4322232d49414965bf03cf793e328968)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.888974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:28.905595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8372cef3efcb462a8c0217409cc2d782, user_id=6f96a0de028a496191db23622f830ac2, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:28.909158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064ff2-3d22-40f6-9684-5fc6035d750a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:29.042578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 857/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:28 2022] PUT /identity/v3/projects/8372cef3efcb462a8c0217409cc2d782/users/6f96a0de028a496191db23622f830ac2/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:29.071669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:29.073607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:29.073893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:29.105639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4322232d49414965bf03cf793e328968', 'request_id': 'req-818c7310-7c18-4b73-8e51-7927b64347f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:29.145247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] MFA Rules not processed for user `41e080abf81d4820ab3c0aef4b89b322`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:29.146976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.200913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:29.242735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4322232d49414965bf03cf793e328968', 'request_id': 'req-818c7310-7c18-4b73-8e51-7927b64347f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:29.252573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4322232d49414965bf03cf793e328968', 'request_id': 'req-818c7310-7c18-4b73-8e51-7927b64347f0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:29.275986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] The token cache is being invalidate because project 4322232d49414965bf03cf793e328968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:29.276341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:29.277183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-818c7310-7c18-4b73-8e51-7927b64347f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:29.279397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 895/1752] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:28 2022] DELETE /identity/v3/projects/4322232d49414965bf03cf793e328968 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:29.281077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:29.281408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:29.281770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:29.301976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:29.312782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 858/1753] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:29.313990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:29.315999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.373144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] MFA Rules not processed for user `6f96a0de028a496191db23622f830ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:29.374531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.576501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749aa73-147d-4263-9d2d-74f866b2195f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:29.591502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:29.594144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:29.594657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:29.595145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:29.598489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.678829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 896/1754] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:29.688148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:29.697308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.751110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:29.754020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167aa95-f749-4ca7-932f-6a89c85c912e service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:29.772516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 859/1755] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:29.776229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:29.776229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:29.776229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:29.806672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:29.808743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:29.892331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fb86-984c-45d3-909d-574da7f01ce9 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:29.912504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:29.913474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:29.913860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:29.914248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] PATH_INFO: `/v3/users/8d132492f1f2465eaf68163584c6ae91` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:29.917744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d132492f1f2465eaf68163584c6ae91)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:29.921859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:29.940861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 860/1756] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:29.942359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:29.944639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.071228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccceb035-1b17-4159-b80e-374106effa52 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.071625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.072400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.072838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.073287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.075508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.165801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.167555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.187640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d132492f1f2465eaf68163584c6ae91'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:30.188582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 861/1757] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:30.189632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.205959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.238997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb5d1-43da-4b84-b751-ff734c8110db service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.239208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d132492f1f2465eaf68163584c6ae91'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:30.247697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d132492f1f2465eaf68163584c6ae91'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:30.248918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d132492f1f2465eaf68163584c6ae91'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:30.249595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edb95306-3364-4170-b7cd-4b59b185b75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d132492f1f2465eaf68163584c6ae91'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:30.258612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.260042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.260519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.260802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.261520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.266701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca1b2f-a405-49a2-a144-c5f280327c8a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.336066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 897/1758] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:29 2022] DELETE /identity/v3/users/8d132492f1f2465eaf68163584c6ae91 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:30.336066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.336066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.336066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.391030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:30.392391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.437465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 862/1759] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:30.442134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.442427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.442708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.482548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:30.483972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.534353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 898/1760] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:30.536601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.541425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.560164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4cb62-c61d-4b12-bfa7-0d35218ae9de None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.593871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 863/1761] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:30.594998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.613296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04907060-de8d-4d00-857e-c47f5ff93c96 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.623819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.625541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.626342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.626342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.626928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:30.629944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.629944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.666617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 864/1762] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:30.671050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.673037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:30.692120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.692904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.693197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.693475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.694549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.697810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.755477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fbcd-e9fb-416d-8073-f31ebed6a058 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.760300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.761116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.761235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.761503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.772025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.773673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.811562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 865/1763] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:30.816148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.830210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6905b7-6aa2-4921-9340-811f17a1156b service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.837064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.838488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.838837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.839179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.839958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.842212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.924616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 899/1764] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/users => generated 291 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:30.928706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.948031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ad8aa-b3a7-43f7-8a0a-2a9f5f7f9abe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.953688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:30.954723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:30.955031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:30.955318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:30.956110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:30.958474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:30.975034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 900/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:30.976154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:30.986554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fadd-67b5-40f2-80cf-3fc974a8851d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:30.987008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 866/1766] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:30.988224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.067142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.067142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.067142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.067670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] PATH_INFO: `/v3/projects/c789e0168a444a35b85b38e5158c7f0b/users/8b2be02a3d3341c38dbc198b03ab8658/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.109699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c789e0168a444a35b85b38e5158c7f0b, user_id=8b2be02a3d3341c38dbc198b03ab8658, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.112902 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.165763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5201b-7d9f-4061-9a3c-6bcbda990e05 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.177266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.178623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.183960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.184526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.189280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.202620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.255236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 901/1767] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:30 2022] PUT /identity/v3/projects/c789e0168a444a35b85b38e5158c7f0b/users/8b2be02a3d3341c38dbc198b03ab8658/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:31.255236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.392613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 867/1768] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:30 2022] POST /identity/v3/users => generated 303 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:31.392613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.405699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764e55-bf82-4265-8f86-ba0348806b39 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.438672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4df6-c3e5-4f31-b014-6208b20e44e0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.458588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.461092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.461092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.461092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.461374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.465145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.509634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 902/1769] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:31.510709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.551278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735ca5-87ea-4a6d-a953-e8482778ce87 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.560328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.562924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.563333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.564069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] PATH_INFO: `/v3/projects/c789e0168a444a35b85b38e5158c7f0b/users/8b2be02a3d3341c38dbc198b03ab8658/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.572424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c789e0168a444a35b85b38e5158c7f0b, user_id=8b2be02a3d3341c38dbc198b03ab8658, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.577462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5148d1-3261-4157-b35a-ba3ba17c5620 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.594801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.595464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.595785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.596180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.596816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.599919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 903/1770] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:31 2022] PUT /identity/v3/projects/c789e0168a444a35b85b38e5158c7f0b/users/8b2be02a3d3341c38dbc198b03ab8658/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:31.607348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.628189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 868/1771] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:19:31.629604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.629898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.630180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.631955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.652065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2315-a654-477e-b543-4cc8f68dbbc7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.705757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] MFA Rules not processed for user `8b2be02a3d3341c38dbc198b03ab8658`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:31.707113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:31.783847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.784530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.784817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.785090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.785816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.787465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.802135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 869/1772] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:31.802135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.804813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:31.830369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5fdb-9252-4b14-be0f-109309b01721 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.835894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.837253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.837631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.838041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] PATH_INFO: `/v3/projects/e2d9e24aba1d478c8bb53220d6e511d3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.844104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 904/1773] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:31.844104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:31.849676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d9e24aba1d478c8bb53220d6e511d3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.854208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:31.893381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732787d1-4c78-490f-b7ad-a7e6c9b6a887 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:31.898617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:31.899829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:31.900148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:31.900467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] PATH_INFO: `/v3/projects/cae2cf8bbc914abaa6ea7c2cd5f87e6f/users/a707171373f24fc18b1c4141ca60ee36/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:31.918522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae2cf8bbc914abaa6ea7c2cd5f87e6f, user_id=a707171373f24fc18b1c4141ca60ee36, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:31.921613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:32.095643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 905/1774] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:31 2022] PUT /identity/v3/projects/cae2cf8bbc914abaa6ea7c2cd5f87e6f/users/a707171373f24fc18b1c4141ca60ee36/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:32.096708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:32.097654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d9e24aba1d478c8bb53220d6e511d3', 'request_id': 'req-7a8d5417-515e-47bf-978f-9efdd3ea5955'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.098941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.115599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:32.173867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f709e48-9dba-4874-9707-c806e6b8def7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:32.215873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d9e24aba1d478c8bb53220d6e511d3', 'request_id': 'req-7a8d5417-515e-47bf-978f-9efdd3ea5955'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.223001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d9e24aba1d478c8bb53220d6e511d3', 'request_id': 'req-7a8d5417-515e-47bf-978f-9efdd3ea5955'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.236757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] The token cache is being invalidate because project e2d9e24aba1d478c8bb53220d6e511d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:32.237221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.238648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7a8d5417-515e-47bf-978f-9efdd3ea5955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.241977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 870/1775] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:31 2022] DELETE /identity/v3/projects/e2d9e24aba1d478c8bb53220d6e511d3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:32.243183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:32.243533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:32.244333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:32.261968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:32.263602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:32.264530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:32.264903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:32.265271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:32.267553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.275928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] MFA Rules not processed for user `a707171373f24fc18b1c4141ca60ee36`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:32.281557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.383385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:32.385175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:32.398661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 871/1776] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:32.398661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:32.398961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 906/1777] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:32.399061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.400416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:32.402015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.503703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10682-a0c9-45d8-b04f-dd674a007d79 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:32.508897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:32.509695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:32.510047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:32.510396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:32.511163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:32.515570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:32.520347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132da98b-169a-4069-9cbf-5b3d2165d0ba None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:32.528560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:32.531407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:32.532774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:32.533586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] PATH_INFO: `/v3/users/fa1950397bd9421daec3cc406ee05335` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:32.535504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1950397bd9421daec3cc406ee05335)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:32.541034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:32.721891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 907/1778] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:32 2022] POST /identity/v3/projects => generated 405 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:32.723274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:32.725953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.795336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1950397bd9421daec3cc406ee05335'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.810906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1950397bd9421daec3cc406ee05335'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.814177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1950397bd9421daec3cc406ee05335'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.815888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1950397bd9421daec3cc406ee05335'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.826621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1950397bd9421daec3cc406ee05335'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:32.840118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d769-5f20-4931-950e-8eed4ffab143 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:32.844247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:32.844910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:32.845224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:32.845702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:32.847669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:32.955239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 872/1779] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:32 2022] DELETE /identity/v3/users/fa1950397bd9421daec3cc406ee05335 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:32.956186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:32.959458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:33.043300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.044881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.056867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 908/1780] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:33.057708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.059117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:33.125719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b328d4-a619-4787-8d7b-ae9979c63246 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.136315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.137116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.137382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.137659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.139669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:33.172636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073585-33b7-4303-9c16-91e5c0c26fab service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.241829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.242995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.244830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.245323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.246516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.249660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.263909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.268021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.306759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 873/1781] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:33.436650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 909/1782] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:33 2022] POST /identity/v3/users => generated 309 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:33.443200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.456441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95242ad-25f7-4823-9687-f5980c5aece5 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.466699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.467536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.468031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.468586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.469417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.472139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.506000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.527330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 874/1783] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:33.528946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85941e-f9c7-460d-bdfe-f1cbfa188e3e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.538086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.544278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.544278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.544278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] PATH_INFO: `/v3/projects/e2ade23db0254153ba25dc4d87d15424/users/7af05429655a4f8096724d60cdba31aa/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.559117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ade23db0254153ba25dc4d87d15424, user_id=7af05429655a4f8096724d60cdba31aa, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.562462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.707941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 910/1784] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:33 2022] PUT /identity/v3/projects/e2ade23db0254153ba25dc4d87d15424/users/7af05429655a4f8096724d60cdba31aa/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:33.709322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.709980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.712709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:33.734368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739533-738b-4617-9737-761b59cbd239 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.802647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.803523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.803804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.804076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] PATH_INFO: `/v3/projects/09b20b842ff443e08d41b978ecd260a8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.805534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b20b842ff443e08d41b978ecd260a8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.808188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.861429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df032ef6-e5c9-48de-9646-ab1fbfa31650 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.867175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.868007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.868396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.868622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.869501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.871241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.882349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 911/1785] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:33.887199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:33.899285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7a68f-1523-49a6-9fe4-99bc117b318e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:33.905203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:33.906217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.906549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.908304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] PATH_INFO: `/v3/projects/e2ade23db0254153ba25dc4d87d15424/users/7af05429655a4f8096724d60cdba31aa/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.909739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ade23db0254153ba25dc4d87d15424, user_id=7af05429655a4f8096724d60cdba31aa, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:33.912528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca4ee3-1071-4b9a-a59a-28366c120eba admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:33.923397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 912/1786] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:33 2022] PUT /identity/v3/projects/e2ade23db0254153ba25dc4d87d15424/users/7af05429655a4f8096724d60cdba31aa/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:33.934453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bde20-8f2f-46ae-8d72-f006d042a7c7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:33.934812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bde20-8f2f-46ae-8d72-f006d042a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:33.935111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bde20-8f2f-46ae-8d72-f006d042a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:33.973333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e42bde20-8f2f-46ae-8d72-f006d042a7c7 None None] MFA Rules not processed for user `7af05429655a4f8096724d60cdba31aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:33.973956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b20b842ff443e08d41b978ecd260a8', 'request_id': 'req-2841f339-a872-4b6b-a500-3f02b6d289b1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:33.974616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e42bde20-8f2f-46ae-8d72-f006d042a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.052216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:34.073497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b20b842ff443e08d41b978ecd260a8', 'request_id': 'req-2841f339-a872-4b6b-a500-3f02b6d289b1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:34.082798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b20b842ff443e08d41b978ecd260a8', 'request_id': 'req-2841f339-a872-4b6b-a500-3f02b6d289b1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:34.106655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] The token cache is being invalidate because project 09b20b842ff443e08d41b978ecd260a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:34.106985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:34.107845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-2841f339-a872-4b6b-a500-3f02b6d289b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:34.116523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 913/1787] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:34.117031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 875/1788] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:33 2022] DELETE /identity/v3/projects/09b20b842ff443e08d41b978ecd260a8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:34.129703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.131076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.132470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.167120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:34.168322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.313588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 914/1789] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:34.323391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.324054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.324646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.349115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:34.350499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.361117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 876/1790] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:34.365287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.376168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75bb85-1177-41fc-a7ae-43d8513920d3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.381171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.381818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.382167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.382622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.383317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:34.383686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.386185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.403211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 915/1791] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:34.407944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.419670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d912b1-3bba-46e9-bf00-09a090cb2b37 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.425412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.426125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.426540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.426990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.449972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.451200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.452222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.456575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.534295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a021e-f022-4ae1-a4ec-4021b5b1b4dd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.538766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.539601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.540110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.541054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.543079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.559571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 877/1792] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:34 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:34.563849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.563958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.564047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.605285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 916/1793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:34.732700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bb0a-4139-4328-8091-a729498c4aa0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.742626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.744339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.745057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.747496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.749589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.752999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.787131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:34.854606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 878/1794] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:34 2022] POST /identity/v3/users => generated 280 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:34.855145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.865506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.867439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:34.871738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ff21-d6bf-4d07-af2a-d4309c2589b5 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.883255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce2dc0-07fa-467f-94c0-2fffd48728c3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.885357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.886687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.888239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.889108 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.890157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.890507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.890852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] PATH_INFO: `/v3/users/a707171373f24fc18b1c4141ca60ee36` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.892476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a707171373f24fc18b1c4141ca60ee36)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.893723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.895768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.895948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.900909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:34.927956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 917/1795] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:19:34.936933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:34.957348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c140-7452-4605-91e9-d9517be476fa admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:34.966568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:34.967831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:34.968286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:34.968681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:34.969579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:34.971652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:35.000118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 918/1796] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:35.021935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:35.040513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe70e92-cae6-42dd-8305-06581a7cd71b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:35.055285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:35.071035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.071035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.071035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] PATH_INFO: `/v3/projects/0d6efb3a40294e5783ef9e5bbef4f406/users/78b16c12e20b4ba6aa9775a64dd2dde7/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.075887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6efb3a40294e5783ef9e5bbef4f406, user_id=78b16c12e20b4ba6aa9775a64dd2dde7, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:35.079373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed22a1-9703-490c-b89e-a2d7dd74fa49 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:35.502172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 919/1797] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:35 2022] PUT /identity/v3/projects/0d6efb3a40294e5783ef9e5bbef4f406/users/78b16c12e20b4ba6aa9775a64dd2dde7/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:35.521150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.521847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a707171373f24fc18b1c4141ca60ee36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:35.522567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.522567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.535211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a707171373f24fc18b1c4141ca60ee36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:35.539487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a707171373f24fc18b1c4141ca60ee36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:35.539487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a707171373f24fc18b1c4141ca60ee36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:35.544429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a707171373f24fc18b1c4141ca60ee36'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:35.552778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] MFA Rules not processed for user `78b16c12e20b4ba6aa9775a64dd2dde7`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:35.554258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:35.623993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 920/1798] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:35.628805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:35.628805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:35.679198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 879/1799] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:34 2022] DELETE /identity/v3/users/a707171373f24fc18b1c4141ca60ee36 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:35.684441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:35.685265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:35.700327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a1673-ceb5-467a-a7fa-2a0688e2aca7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:35.749140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413cbd-8892-407c-bd2b-7f7bd083fb18 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:35.752961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:35.758756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.758756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.758756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.771530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:35.772576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.772927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.773269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] PATH_INFO: `/v3/users/c302d0e82dae4f60bcd0ccb8ac550076` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.775083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c302d0e82dae4f60bcd0ccb8ac550076)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:35.777112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:35.823392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:35.824875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44578a8-55bb-4bb1-a5ac-b06b0d52cbe9 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:35.834288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 880/1800] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:35.835421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.835701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.836094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.856024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:35.857282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:35.867590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 881/1801] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:35.867590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:35.867590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:35.880148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1ba1b-06ec-4458-827e-935f1e21180a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:35.885725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:35.886862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:35.887144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:35.887462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] PATH_INFO: `/v3/users/78b16c12e20b4ba6aa9775a64dd2dde7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:35.888696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b16c12e20b4ba6aa9775a64dd2dde7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:35.890621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:36.039924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c302d0e82dae4f60bcd0ccb8ac550076'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.062757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c302d0e82dae4f60bcd0ccb8ac550076'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.072296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c302d0e82dae4f60bcd0ccb8ac550076'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.073051 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c302d0e82dae4f60bcd0ccb8ac550076'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.073673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c302d0e82dae4f60bcd0ccb8ac550076'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.144683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b16c12e20b4ba6aa9775a64dd2dde7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.158301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b16c12e20b4ba6aa9775a64dd2dde7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.159045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b16c12e20b4ba6aa9775a64dd2dde7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.159657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b16c12e20b4ba6aa9775a64dd2dde7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.172976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 921/1802] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:35 2022] DELETE /identity/v3/users/c302d0e82dae4f60bcd0ccb8ac550076 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:36.173410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:36.175064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.175923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7a3bae7-ac26-4e22-95f9-93228cad2863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b16c12e20b4ba6aa9775a64dd2dde7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:36.252335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbab4e-e69b-4140-873b-32c6ab5b8463 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:36.256629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:36.257469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:36.257896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:36.258315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:36.261110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.273499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 882/1803] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:35 2022] DELETE /identity/v3/users/78b16c12e20b4ba6aa9775a64dd2dde7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:36.277638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:36.278091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:36.278671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:36.300890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:36.305113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.334006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:36.340649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c029f-a773-4164-b379-3ff385408b2e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:36.347645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 922/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:36.363259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:36.363674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:36.364705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:36.404745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:36.405915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.418831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 883/1805] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:36.429769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:36.433485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.447959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 923/1806] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:36.449122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:36.450670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:36.514081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8a51e-93c0-41f4-aee5-eeba559473c5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:36.519410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:36.520058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:36.520375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:36.520653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:36.530974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:36.532547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:36.534096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc021fb-1cb0-407e-aacb-838b7351e3cf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:36.538655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:36.539362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:36.539615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:36.539895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:36.549730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 884/1807] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:36.554343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:36.562344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:36.574635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 924/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:36.586415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:36.614541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:37.325872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:37.327916 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:37.345348 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fc163-559d-4705-b429-cd9401be3256 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:37.352866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:37.354876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:37.356618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:37.357145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] PATH_INFO: `/v3/projects/cae2cf8bbc914abaa6ea7c2cd5f87e6f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:37.358728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae2cf8bbc914abaa6ea7c2cd5f87e6f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:37.360910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:37.549821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:37.549821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:37.568821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20942424-52b4-48ab-97ae-cdcb735a4270 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:37.572473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae2cf8bbc914abaa6ea7c2cd5f87e6f', 'request_id': 'req-6baf2d09-6632-48e7-9573-66f85b3ab959'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.645796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:37.646668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:37.646945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:37.647219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] PATH_INFO: `/v3/projects/00e1155eea8d4ab68ef64aad32487694` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:37.648466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e1155eea8d4ab68ef64aad32487694)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:37.650401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:37.684031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae2cf8bbc914abaa6ea7c2cd5f87e6f', 'request_id': 'req-6baf2d09-6632-48e7-9573-66f85b3ab959'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.695667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae2cf8bbc914abaa6ea7c2cd5f87e6f', 'request_id': 'req-6baf2d09-6632-48e7-9573-66f85b3ab959'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.711913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] The token cache is being invalidate because project cae2cf8bbc914abaa6ea7c2cd5f87e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:37.712312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.713072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.714877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 885/1809] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:37 2022] DELETE /identity/v3/projects/cae2cf8bbc914abaa6ea7c2cd5f87e6f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:37.715846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:37.717792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:37.734365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2d09-6632-48e7-9573-66f85b3ab959 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:37.739407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:37.740312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:37.740588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:37.740826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] PATH_INFO: `/v3/projects/0d6efb3a40294e5783ef9e5bbef4f406` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:37.742019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6efb3a40294e5783ef9e5bbef4f406)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:37.744641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:37.855681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e1155eea8d4ab68ef64aad32487694', 'request_id': 'req-b9736b91-316a-4376-b6e3-0202e5e825ef'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.918355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6efb3a40294e5783ef9e5bbef4f406', 'request_id': 'req-389cad89-1787-45dc-9faa-cd76ed5a8372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.969830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e1155eea8d4ab68ef64aad32487694', 'request_id': 'req-b9736b91-316a-4376-b6e3-0202e5e825ef'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.979010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e1155eea8d4ab68ef64aad32487694', 'request_id': 'req-b9736b91-316a-4376-b6e3-0202e5e825ef'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.991193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] The token cache is being invalidate because project 00e1155eea8d4ab68ef64aad32487694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:37.991846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.992856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:37.995202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 925/1810] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:37 2022] DELETE /identity/v3/projects/00e1155eea8d4ab68ef64aad32487694 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:37.996471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.000263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.072104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6efb3a40294e5783ef9e5bbef4f406', 'request_id': 'req-389cad89-1787-45dc-9faa-cd76ed5a8372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.088662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6efb3a40294e5783ef9e5bbef4f406', 'request_id': 'req-389cad89-1787-45dc-9faa-cd76ed5a8372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.106523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9736b91-316a-4376-b6e3-0202e5e825ef admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.109074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] The token cache is being invalidate because project 0d6efb3a40294e5783ef9e5bbef4f406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:38.109202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.110314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-389cad89-1787-45dc-9faa-cd76ed5a8372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.113434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 886/1811] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:37 2022] DELETE /identity/v3/projects/0d6efb3a40294e5783ef9e5bbef4f406 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:38.115985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafae04-a9fd-4483-b2d9-ff6f86dd0b4b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.116571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafae04-a9fd-4483-b2d9-ff6f86dd0b4b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.116970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafae04-a9fd-4483-b2d9-ff6f86dd0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.148833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-deafae04-a9fd-4483-b2d9-ff6f86dd0b4b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:38.154355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-deafae04-a9fd-4483-b2d9-ff6f86dd0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.178554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.183092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.183092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.183092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] PATH_INFO: `/v3/users/7af05429655a4f8096724d60cdba31aa` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.183092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af05429655a4f8096724d60cdba31aa)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.184111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.288585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 887/1812] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:38.288585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bda6f-d068-4c46-9242-35b2e2789008 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.294559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bda6f-d068-4c46-9242-35b2e2789008 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.294932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bda6f-d068-4c46-9242-35b2e2789008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.349884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-726bda6f-d068-4c46-9242-35b2e2789008 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:38.352088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-726bda6f-d068-4c46-9242-35b2e2789008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.362217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 888/1813] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:38.364602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa317-41b5-4414-ae73-309b91def7b9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.364968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa317-41b5-4414-ae73-309b91def7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.365344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa317-41b5-4414-ae73-309b91def7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.395082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d21fa317-41b5-4414-ae73-309b91def7b9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:38.408516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d21fa317-41b5-4414-ae73-309b91def7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.419221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af05429655a4f8096724d60cdba31aa'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.427285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 889/1814] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:38.429446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.429939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.430545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.441424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af05429655a4f8096724d60cdba31aa'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.450794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af05429655a4f8096724d60cdba31aa'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.451544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af05429655a4f8096724d60cdba31aa'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.452637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af05429655a4f8096724d60cdba31aa'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:38.456645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:38.458124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.466693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 890/1815] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:38.467633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.469083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.489479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496900c-9fe4-446c-b21f-6fd1f432c273 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.499180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.499901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.500378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.500651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.501391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:38.501694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.503414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.525915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 891/1816] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:38.527167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.541814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb73b5-cdc5-4ec5-a685-52eb92fb19ff admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.548127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.548863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.549334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.549705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.551991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:38.559367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.567777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.571504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 926/1817] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:37 2022] DELETE /identity/v3/users/7af05429655a4f8096724d60cdba31aa => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:38.584755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.598965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 892/1818] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:38.603880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.616449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb46-3d1a-4d0f-b360-8e8bde14d93e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.670351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb114a18-14ea-40a2-a6b5-b82cbc94ee13 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.675662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.676816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.677226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.677627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.678394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.680770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.690227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.691012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.691344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.691604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.693213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.695450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.824693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 927/1819] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:38.825537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.827472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.879949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 893/1820] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/projects => generated 365 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:38.881085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.905054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea14e7-c90a-458e-a73b-b55b45ecc70a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.950997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b002f0-69a1-49b5-ba87-00e360ab7c2a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.957027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.957834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.958114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.958393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.959092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.961145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.968686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.970693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.971006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.971416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] PATH_INFO: `/v3/users/fdfa10a0565046e0999bc05f8ab06bf9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.973675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfa10a0565046e0999bc05f8ab06bf9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.976063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.063545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 894/1821] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:38 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:39.064876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.097255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5d8b7-3a21-4c25-a0ec-e2598f71cb87 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.102342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.103062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.103346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.103619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.104344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.106323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.167595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfa10a0565046e0999bc05f8ab06bf9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.179844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfa10a0565046e0999bc05f8ab06bf9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.187539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfa10a0565046e0999bc05f8ab06bf9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.188322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfa10a0565046e0999bc05f8ab06bf9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.189204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfa10a0565046e0999bc05f8ab06bf9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.192628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:39.271020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 895/1822] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:39 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:39.271020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.272556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.285786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c66e5-3ec3-418c-8cae-57a10b0c5c64 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.290983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:39.297350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.297350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.297350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.297350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.297705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.297705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.299717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 928/1823] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:38 2022] DELETE /identity/v3/users/fdfa10a0565046e0999bc05f8ab06bf9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:39.302714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.309819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.311821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 896/1824] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:39.312905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.315390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.348458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b425-404d-4bd5-aaec-359e7f3c516d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.396273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.397813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0ad9f-70a1-43a9-a554-400f267ef03b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.403359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.404284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.404409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.404607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.404761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.404856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] PATH_INFO: `/v3/projects/e2ade23db0254153ba25dc4d87d15424` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.405018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.405837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.406053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ade23db0254153ba25dc4d87d15424)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.407762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a536e2-8b27-4f10-8b49-5b1bb033d84b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.407990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.421681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 897/1825] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:39.421681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.421681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.421681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.438878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:39.440169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.451278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 898/1826] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:39.451278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.459532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c643-d70e-4bb5-a2f7-4b572f290a85 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.464791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.465520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.465773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.466052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.466800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.468456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.479874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 899/1827] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:39.480127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.491409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb34fc-f58b-42d7-8c2d-bf599cec7a3e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.496038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.496735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.497023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.497300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.498008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.499600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.509812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 900/1828] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:39.510633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.512343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.551707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ade23db0254153ba25dc4d87d15424', 'request_id': 'req-d7267300-3c77-4f89-9e21-628ea21758a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.571254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97071d-c1f9-40a2-b206-d8275d44844f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.626723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.627530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.627697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.627974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.654167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ade23db0254153ba25dc4d87d15424', 'request_id': 'req-d7267300-3c77-4f89-9e21-628ea21758a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.661753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ade23db0254153ba25dc4d87d15424', 'request_id': 'req-d7267300-3c77-4f89-9e21-628ea21758a4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.673528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] The token cache is being invalidate because project e2ade23db0254153ba25dc4d87d15424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:39.674931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.674931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:39.676097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 929/1829] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:39 2022] DELETE /identity/v3/projects/e2ade23db0254153ba25dc4d87d15424 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:39.677109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.678527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.701727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.703594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.716037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 901/1830] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:39.716778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:39.727952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525caf0-c111-4afe-a9ab-aade68c8623e service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.735158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.735927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.736231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.742694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] PATH_INFO: `/v3/projects/9306f786142149c5bc871b2007e0f6ef/users/c1b50b66fdf340da8ddb1da4fe4fbce1/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.774052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267300-3c77-4f89-9e21-628ea21758a4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:39.780756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:39.781754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.782034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.782370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] PATH_INFO: `/v3/projects/244ff0f2135b482fb30aa38927047453/users/44070cbed3774391aeda64fc78f51485/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.783129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9306f786142149c5bc871b2007e0f6ef, user_id=c1b50b66fdf340da8ddb1da4fe4fbce1, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.785892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4e675-ee71-49e0-a20e-9a22540ba339 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.801864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=244ff0f2135b482fb30aa38927047453, user_id=44070cbed3774391aeda64fc78f51485, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:39.805841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e856e20-c6ab-43bf-b1f7-4ad3629ad99f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:39.906258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 902/1831] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:39 2022] PUT /identity/v3/projects/9306f786142149c5bc871b2007e0f6ef/users/c1b50b66fdf340da8ddb1da4fe4fbce1/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:39.906258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2647a-1a7f-48d0-915f-f5978dc2f192 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.906258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2647a-1a7f-48d0-915f-f5978dc2f192 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.906258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2647a-1a7f-48d0-915f-f5978dc2f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.914826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 930/1832] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:39 2022] PUT /identity/v3/projects/244ff0f2135b482fb30aa38927047453/users/44070cbed3774391aeda64fc78f51485/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:39.914826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004ec5-8746-4725-8b2e-c5cebcebaec1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:39.914826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004ec5-8746-4725-8b2e-c5cebcebaec1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:39.914826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004ec5-8746-4725-8b2e-c5cebcebaec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:39.922261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d9d2647a-1a7f-48d0-915f-f5978dc2f192 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:39.925222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d9d2647a-1a7f-48d0-915f-f5978dc2f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:39.951310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-53004ec5-8746-4725-8b2e-c5cebcebaec1 None None] MFA Rules not processed for user `c1b50b66fdf340da8ddb1da4fe4fbce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:39.953169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-53004ec5-8746-4725-8b2e-c5cebcebaec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.013561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 903/1833] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:40.015005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.015296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.015578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.064166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] MFA Rules not processed for user `44070cbed3774391aeda64fc78f51485`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:40.080729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.095469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 931/1834] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:40.099696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.100252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.104065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.155706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:40.158250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.182123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 932/1835] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:40.182123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:40.182123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.218239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 904/1836] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:40.223508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:40.239914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55dc33-23d7-4fc0-967e-4a199eaba2c7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:40.246082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:40.246771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.247054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.247740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.260524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:40.261691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:40.267057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:40.284684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a5e7e-4be5-4033-8879-879d51940930 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:40.288788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:40.289492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.290111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.290111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.292173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 905/1837] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:40.293185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:40.296020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.299977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:40.301483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:40.312894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 933/1838] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:40.313778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:40.341173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834c77d-15b2-4c3d-ac8a-512f5c5714e0 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:40.351015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:40.351701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.351979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.352297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.353039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:40.354985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:40.500023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ef04-b6b4-4459-85e3-5be58fc5cc31 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:40.507941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:40.509540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.509898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.510243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.520136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:40.522048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:40.533937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 906/1839] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:40.752135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:40.753700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:40.768214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09506e-7b0c-4723-8a4c-4e5974d9d804 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:40.773934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:40.775769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:40.776099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:40.776371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] PATH_INFO: `/v3/projects/7db5f58131c44809999487ba1614722c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:40.777962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db5f58131c44809999487ba1614722c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:40.780057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:41.337155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 934/1840] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:40 2022] POST /identity/v3/projects => generated 373 bytes in 1024 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:41.341261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:41.381585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db5f58131c44809999487ba1614722c', 'request_id': 'req-7db7ade9-d828-4365-a14b-4045b910266d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.447436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c415-8f9f-48c2-8f49-2335897ddc76 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:41.455660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db5f58131c44809999487ba1614722c', 'request_id': 'req-7db7ade9-d828-4365-a14b-4045b910266d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.464901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db5f58131c44809999487ba1614722c', 'request_id': 'req-7db7ade9-d828-4365-a14b-4045b910266d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.482067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] The token cache is being invalidate because project 7db5f58131c44809999487ba1614722c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:41.482379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.483196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.484827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 907/1841] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:40 2022] DELETE /identity/v3/projects/7db5f58131c44809999487ba1614722c => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:41.488586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:41.490703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:41.510308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:41.510984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:41.511272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:41.511543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:41.512258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:41.514192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:41.557233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ade9-d828-4365-a14b-4045b910266d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:41.561748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:41.562654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:41.562933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:41.563209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] PATH_INFO: `/v3/users/f5c9499b42124c2a9919543f866c09ac` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:41.564525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c9499b42124c2a9919543f866c09ac)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:41.566450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:41.734835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 935/1842] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:41 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:41.734835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:41.734835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:41.748874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4b27-453f-4398-bf48-3489bb81cb67 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:41.769638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:41.770639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:41.770801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:41.771081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] PATH_INFO: `/v3/users/41e080abf81d4820ab3c0aef4b89b322` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:41.772389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e080abf81d4820ab3c0aef4b89b322)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:41.775515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:41.858589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c9499b42124c2a9919543f866c09ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.870704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c9499b42124c2a9919543f866c09ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.871436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c9499b42124c2a9919543f866c09ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.872112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c9499b42124c2a9919543f866c09ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.879167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c9499b42124c2a9919543f866c09ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:41.963250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 908/1843] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:41 2022] DELETE /identity/v3/users/f5c9499b42124c2a9919543f866c09ac => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:41.964184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:41.967197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.010324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e080abf81d4820ab3c0aef4b89b322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.024025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e080abf81d4820ab3c0aef4b89b322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.034163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e080abf81d4820ab3c0aef4b89b322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.034785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e080abf81d4820ab3c0aef4b89b322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.039350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e080abf81d4820ab3c0aef4b89b322'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.044731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25c473-df7e-4030-b7e9-3806a88418e3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.053567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.054261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.054568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.054793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.055516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.057192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37dad9-f862-4fd0-80c1-9b5868dd9ca0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.067808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 909/1844] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:42.072955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.079964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.079964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.092941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:42.094157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.102744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 910/1845] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:42.103680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.104991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.117686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed58fb-70dd-4120-be11-46ac17bfde2e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.122926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.123590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.123867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.124141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.124889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.126545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.141587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 911/1846] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:42.141587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.143487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.154485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 936/1847] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:41 2022] DELETE /identity/v3/users/41e080abf81d4820ab3c0aef4b89b322 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:42.155384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.207833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:42.235828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838554cb-0a7c-43be-a8ec-4fa668455e36 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.241243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694592-65e0-4d7a-af71-1a4fccb140f0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.248615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.250050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.250577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.250985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] PATH_INFO: `/v3/projects/44d7f4b422314fe69a12a011dc1b6a7e/users/0ba2eae4521c4a73938ea2033662b8b5/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.270858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d7f4b422314fe69a12a011dc1b6a7e, user_id=0ba2eae4521c4a73938ea2033662b8b5, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.275267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.325130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.326408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.326408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.326408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.343498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.349997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.359829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 912/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:42.360742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.362192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.378459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14fcd-4ef9-409d-a526-0c4b4f380386 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.384959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.389935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.389935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.389935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] PATH_INFO: `/v3/users/6f96a0de028a496191db23622f830ac2` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.389935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f96a0de028a496191db23622f830ac2)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.391001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.422443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 937/1849] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:42 2022] PUT /identity/v3/projects/44d7f4b422314fe69a12a011dc1b6a7e/users/0ba2eae4521c4a73938ea2033662b8b5/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:42.423390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.426673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.551564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fc9d-85b9-48cb-9d37-f995067a2776 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:42.557222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:42.558110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.558386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.558656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] PATH_INFO: `/v3/users/44070cbed3774391aeda64fc78f51485` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.559907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44070cbed3774391aeda64fc78f51485)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:42.562077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:42.642594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f96a0de028a496191db23622f830ac2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.667099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f96a0de028a496191db23622f830ac2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.673270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f96a0de028a496191db23622f830ac2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.676712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f96a0de028a496191db23622f830ac2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.686689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-124efef5-90e2-4d85-8db8-8b9345adb5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f96a0de028a496191db23622f830ac2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.778755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 913/1850] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:42 2022] DELETE /identity/v3/users/6f96a0de028a496191db23622f830ac2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:42.780776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d6ce-60a8-4107-a2e0-4e2c93db86a5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.781127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d6ce-60a8-4107-a2e0-4e2c93db86a5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.781407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d6ce-60a8-4107-a2e0-4e2c93db86a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.803223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44070cbed3774391aeda64fc78f51485'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.817475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-04f0d6ce-60a8-4107-a2e0-4e2c93db86a5 None None] MFA Rules not processed for user `0ba2eae4521c4a73938ea2033662b8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:42.821944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44070cbed3774391aeda64fc78f51485'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.822140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-04f0d6ce-60a8-4107-a2e0-4e2c93db86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.829664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44070cbed3774391aeda64fc78f51485'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.830509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44070cbed3774391aeda64fc78f51485'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.831184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a4f27174-95ed-473d-9f20-3a2ae90e1a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44070cbed3774391aeda64fc78f51485'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:42.902468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 914/1851] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:42.903755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.904081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.904399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.906219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 915/1852] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:19:42.906782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:42.909361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:42.963382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 938/1853] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:42 2022] DELETE /identity/v3/users/44070cbed3774391aeda64fc78f51485 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:42.964799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:42.965083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:42.965356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:42.999882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:43.001287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.046046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbd15-59c7-4387-83bf-5a99184ddd34 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.072530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 939/1854] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:43.073646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.074980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.087604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa881-a134-4b8e-9528-cb0c795aea63 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.096025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.096025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.096025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.096025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.096805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.097614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c119-6125-4f4f-93ca-09ef22e0c07f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.129513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.130382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.139259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.139259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] PATH_INFO: `/v3/projects/ea9f604cffb4498fae533af7fa861520` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.139259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9f604cffb4498fae533af7fa861520)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.139259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.285968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 940/1855] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:43 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:43.287594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.287594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.287765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.299057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9f604cffb4498fae533af7fa861520', 'request_id': 'req-cf398701-40e7-4782-a7a5-fab0c90b8345'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.310335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:43.311559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.374440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9f604cffb4498fae533af7fa861520', 'request_id': 'req-cf398701-40e7-4782-a7a5-fab0c90b8345'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.381103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9f604cffb4498fae533af7fa861520', 'request_id': 'req-cf398701-40e7-4782-a7a5-fab0c90b8345'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.381732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 941/1856] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:43.382593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.384561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.397580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] The token cache is being invalidate because project ea9f604cffb4498fae533af7fa861520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:43.400216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.400998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cf398701-40e7-4782-a7a5-fab0c90b8345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.402705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 916/1857] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:42 2022] DELETE /identity/v3/projects/ea9f604cffb4498fae533af7fa861520 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:43.403941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.404245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.404521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.422908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:43.423758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.456603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4893113-301c-40c5-b589-135c2c90ac4d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.464141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.465059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.465341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.468361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] PATH_INFO: `/v3/projects/ca8d31da5412492d878d70be20f89da3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.468361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8d31da5412492d878d70be20f89da3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.468851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.496607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 917/1858] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:43.497387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.498705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.563733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda928-8659-419b-b3ce-008ff11adc90 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.567457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.568219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.568504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.568775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.570554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.583182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.585079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.593185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8d31da5412492d878d70be20f89da3', 'request_id': 'req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.595567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 918/1859] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:43.596551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.597854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.609678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc068a-eaf5-49e9-8f3a-597bd2337b13 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.668935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.669135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.669294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.669559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.670234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.672150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a1faa-520a-41a0-95b3-d9461cdb4c82 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.724250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8d31da5412492d878d70be20f89da3', 'request_id': 'req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.731196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8d31da5412492d878d70be20f89da3', 'request_id': 'req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.741744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] The token cache is being invalidate because project ca8d31da5412492d878d70be20f89da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:43.742053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.742723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:43.744865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 942/1860] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:43 2022] DELETE /identity/v3/projects/ca8d31da5412492d878d70be20f89da3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:43.745763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.749290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.809636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 919/1861] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:43 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:43.811123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523bb02-2185-4489-af50-334758c08daf None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.811563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523bb02-2185-4489-af50-334758c08daf None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.812167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523bb02-2185-4489-af50-334758c08daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.821866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e08de-4179-4c82-9a9d-64bf1b5cf21b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.829288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.830048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.830307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.830588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.831886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6523bb02-2185-4489-af50-334758c08daf None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:43.833470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.833579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6523bb02-2185-4489-af50-334758c08daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.842499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 920/1862] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:43.843497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523bb02-2185-4489-af50-334758c08daf None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.845159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6523bb02-2185-4489-af50-334758c08daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.849177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.849177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.860562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 943/1863] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:43.861417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.862800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.889973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ceb9-2a6c-411f-b838-82c9106f598e service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.904549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.905852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.906396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.906774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] PATH_INFO: `/v3/users/794da196157f4e2e984c805348b09b96` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.908296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794da196157f4e2e984c805348b09b96)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.910350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.915558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523bb02-2185-4489-af50-334758c08daf None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:43.927635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:43.929620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:43.929620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:43.929823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:43.932935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.946864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:43.948337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:43.966195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 921/1864] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:43.969551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:43.971040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:43.986416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:44.001406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a897d-25af-4274-a6c0-63a65ba670eb service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.013186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.013880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.014217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.014406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.015946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.020689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81571b4-01b7-4ec4-814d-d24e46ad8f77 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.045740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 922/1865] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:44.047231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.047661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.047926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.085003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:44.086394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:44.101746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 923/1866] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:44.102926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.121081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0bc0-f17d-4d79-ac3a-d8e9b170fb3d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.129868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.131609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.131986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.132556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] PATH_INFO: `/v3/projects/49bcb4edd9514cee806c521873cbbe3f/users/205971ca4ce94ed7be98aba779c6ea22/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.150289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bcb4edd9514cee806c521873cbbe3f, user_id=205971ca4ce94ed7be98aba779c6ea22, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.153763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.170684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794da196157f4e2e984c805348b09b96'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.186202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794da196157f4e2e984c805348b09b96'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.198778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794da196157f4e2e984c805348b09b96'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.202691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794da196157f4e2e984c805348b09b96'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.202691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794da196157f4e2e984c805348b09b96'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.276847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 944/1867] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:43 2022] DELETE /identity/v3/users/794da196157f4e2e984c805348b09b96 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:44.279862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 924/1868] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:44 2022] PUT /identity/v3/projects/49bcb4edd9514cee806c521873cbbe3f/users/205971ca4ce94ed7be98aba779c6ea22/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:44.281082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.282368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:44.283656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.288022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:44.376655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da73c8-da9c-44ad-ad9a-55a847691816 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.436047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec3bf7-2aa4-4e9a-bd66-d4cf0e90d1b0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.449218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.449854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.452116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.453166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.453935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:44.455835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.457484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.489787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 945/1869] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:44.491440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.494725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:44.523264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.523981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.524293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.524605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.525351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.531699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.536427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d0dc-052c-46b9-9312-5da48e1904f6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.546364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.547249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.547527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.547798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] PATH_INFO: `/v3/projects/8372cef3efcb462a8c0217409cc2d782` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.549783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8372cef3efcb462a8c0217409cc2d782)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.554063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 925/1870] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:19:44.554217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.554307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.565532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63890f-0550-48b2-a400-a4ff282ee43e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.570706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.571444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.571809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.572004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.572887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.574836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.694202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 926/1871] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:44 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:44.697053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.730992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8372cef3efcb462a8c0217409cc2d782', 'request_id': 'req-b73f2f76-3574-4089-b000-69702637044b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.827836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea4e1-6191-497d-a230-651fa974b57a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.832926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.834018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.834431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.834720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] PATH_INFO: `/v3/projects/49bcb4edd9514cee806c521873cbbe3f/users/205971ca4ce94ed7be98aba779c6ea22/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.837493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bcb4edd9514cee806c521873cbbe3f, user_id=205971ca4ce94ed7be98aba779c6ea22, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.840176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.859605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 927/1872] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:44 2022] PUT /identity/v3/projects/49bcb4edd9514cee806c521873cbbe3f/users/205971ca4ce94ed7be98aba779c6ea22/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:44.860829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.879927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8372cef3efcb462a8c0217409cc2d782', 'request_id': 'req-b73f2f76-3574-4089-b000-69702637044b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.890787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8372cef3efcb462a8c0217409cc2d782', 'request_id': 'req-b73f2f76-3574-4089-b000-69702637044b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.904801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] The token cache is being invalidate because project 8372cef3efcb462a8c0217409cc2d782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:44.905186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.905869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:44.912697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 946/1873] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:44 2022] DELETE /identity/v3/projects/8372cef3efcb462a8c0217409cc2d782 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:44.914131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:44.916537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:44.945751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625797f7-c70b-43f7-99ee-a89fbf0240b8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:44.950970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:44.951659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:44.951941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:44.952541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:44.953266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:44.955202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526cad8-cb6b-4944-b9d1-8ab5686240ed admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:44.998055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2f76-3574-4089-b000-69702637044b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.003072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.003944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.004262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.004592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] PATH_INFO: `/v3/projects/244ff0f2135b482fb30aa38927047453` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.005766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244ff0f2135b482fb30aa38927047453)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.007729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.078569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 928/1874] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:44 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:45.080004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.080320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.080598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.106630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] MFA Rules not processed for user `205971ca4ce94ed7be98aba779c6ea22`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:45.107875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.169073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244ff0f2135b482fb30aa38927047453', 'request_id': 'req-0148ec73-b430-4d95-9386-436916fb0986'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.179261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 929/1875] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:45.180282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.182307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.201126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32473f7d-17ac-4077-bdfa-094fdde06f18 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.256611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.258123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.258402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.258671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] PATH_INFO: `/v3/users/8b2be02a3d3341c38dbc198b03ab8658` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.259945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2be02a3d3341c38dbc198b03ab8658)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.262041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.295878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244ff0f2135b482fb30aa38927047453', 'request_id': 'req-0148ec73-b430-4d95-9386-436916fb0986'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.303703 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244ff0f2135b482fb30aa38927047453', 'request_id': 'req-0148ec73-b430-4d95-9386-436916fb0986'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.314895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] The token cache is being invalidate because project 244ff0f2135b482fb30aa38927047453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:45.315185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.315871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.317524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 947/1876] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:44 2022] DELETE /identity/v3/projects/244ff0f2135b482fb30aa38927047453 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:45.324211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.324211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.334052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ec73-b430-4d95-9386-436916fb0986 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.341229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.342203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.342361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.342629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] PATH_INFO: `/v3/projects/a3228019f489452695105c1b22e67785` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.343809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3228019f489452695105c1b22e67785)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.348715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.523141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2be02a3d3341c38dbc198b03ab8658'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.542279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3228019f489452695105c1b22e67785', 'request_id': 'req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.547473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2be02a3d3341c38dbc198b03ab8658'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.548234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2be02a3d3341c38dbc198b03ab8658'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.548868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2be02a3d3341c38dbc198b03ab8658'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.558459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2be02a3d3341c38dbc198b03ab8658'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.661523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3228019f489452695105c1b22e67785', 'request_id': 'req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.668900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3228019f489452695105c1b22e67785', 'request_id': 'req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.677882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:45.682624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] The token cache is being invalidate because project a3228019f489452695105c1b22e67785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:45.682910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.683629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:45.688774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 948/1877] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:45 2022] DELETE /identity/v3/projects/a3228019f489452695105c1b22e67785 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:45.688774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.688774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.735606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 930/1878] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:45 2022] DELETE /identity/v3/users/8b2be02a3d3341c38dbc198b03ab8658 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:45.736547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.745845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.771012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5056-683b-4f42-9c6d-bd9c4f7dbf79 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.839354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.840031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.840651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.840931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.841857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.843501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45503174-19d6-4e0e-a27b-7cfc1fb59519 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.848936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f72879-6afd-4db1-9755-1e10114abacc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.851235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.851900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.852160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.853027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.854974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.859176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 949/1879] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:45.859176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68c37-5423-443c-a430-31bcb913677b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.859176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68c37-5423-443c-a430-31bcb913677b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.859176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68c37-5423-443c-a430-31bcb913677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.878959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-38e68c37-5423-443c-a430-31bcb913677b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:45.880173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-38e68c37-5423-443c-a430-31bcb913677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.888292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 950/1880] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:45.889694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.889982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.890255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.910123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:45.911319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.920348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 951/1881] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:45.921257 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.924772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.926602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b5d48-d9c5-4521-9c19-e39c4a31bdf6 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.931454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189e3ea-1f3d-4975-933c-cc4d0f567f65 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.936374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.937046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.937330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.937796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 931/1882] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:45.938969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.939300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.939408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.939495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.940088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:45.941830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29669e67-182b-41f2-8e51-767fe6126525 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:45.956375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 952/1883] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:45.958193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.958631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.958905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:45.969910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:45.969910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.974563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 932/1884] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:45.975366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.979959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:45.981373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:45.988219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62611453-0e13-48bc-a264-4ad7d41f15b2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:45.990904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 953/1885] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:45.991944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:45.995705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:45.996871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:45.997216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:45.997582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] PATH_INFO: `/v3/projects/51d145fccd464ac39676a7eafbd08934/users/2b1da2404fad405f83f4086116736bc9/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.002612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5004-ef2a-467e-883f-c4c9c6e5a3c1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.007616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.008346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.009784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.009784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.009784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:46.010288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.011901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.014741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d145fccd464ac39676a7eafbd08934, user_id=2b1da2404fad405f83f4086116736bc9, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.017492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.025799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 954/1886] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:46.026738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.038106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcb282-6164-4313-8fe6-2a80b4233979 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.049231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.050134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.050509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.050894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.051723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:46.052153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.054057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.075235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 955/1887] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:46.076441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.089385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8cd07-3e93-44e3-a681-839e444b7e28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.094369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.095348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.095720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.096057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.096848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.099012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebae2-fbc9-462f-acc0-23847ea79f5d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.192426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 933/1888] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:45 2022] PUT /identity/v3/projects/51d145fccd464ac39676a7eafbd08934/users/2b1da2404fad405f83f4086116736bc9/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:46.193408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.233769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 956/1889] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:46.235385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.235705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.236015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.269486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] MFA Rules not processed for user `2b1da2404fad405f83f4086116736bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:46.270751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.278291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0688d-2de5-4d69-86a2-21c58254c725 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.353177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.353844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.354318 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.354477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.355234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.357421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.384391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 957/1890] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:46.385500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.397604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe246c8-4174-4cea-bd09-18ee83b876e6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.402571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.403242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.403520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.403796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.404595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.406503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.483708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 934/1891] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/projects => generated 391 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:46.483708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.483708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.536307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 958/1892] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:46.537128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.538920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.549074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027133-0ade-4db8-af36-9db18cb4b5fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.554216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.555133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.555419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.555738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] PATH_INFO: `/v3/projects/c789e0168a444a35b85b38e5158c7f0b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.558489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c789e0168a444a35b85b38e5158c7f0b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.561079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.596994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65012b-e1fc-4029-ae6f-fb74b76adc6e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.647485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.648275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.648532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.648806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.650580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.709177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.709940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.721835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c789e0168a444a35b85b38e5158c7f0b', 'request_id': 'req-b5e5ec78-17de-4256-a146-d17e0797ce28'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:46.724592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 959/1893] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:46.725914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.739211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc487c-4824-4f52-80a6-ecf2c73df3d2 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.807515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.808104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.808418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.808696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.809385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.811293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.844007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c789e0168a444a35b85b38e5158c7f0b', 'request_id': 'req-b5e5ec78-17de-4256-a146-d17e0797ce28'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:46.854113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c789e0168a444a35b85b38e5158c7f0b', 'request_id': 'req-b5e5ec78-17de-4256-a146-d17e0797ce28'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:46.864679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] The token cache is being invalidate because project c789e0168a444a35b85b38e5158c7f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:46.864965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:46.865692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:46.867589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 935/1894] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:46 2022] DELETE /identity/v3/projects/c789e0168a444a35b85b38e5158c7f0b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:46.868478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.870188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.883393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ec78-17de-4256-a146-d17e0797ce28 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.887961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.888703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.888968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.889242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.889932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.891464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 960/1895] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:46.891900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.892794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.896091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:46.964523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354aef5-69dd-4432-8d04-e7c551976a51 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:46.969557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:46.970250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.970528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.970799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.971523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:46.973134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ae505-e35a-4b84-93dc-137d0f2a7347 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:46.987111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 961/1896] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:46.987649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:46.987940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:46.988230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:46.991951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 936/1897] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:46.992934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:46.994608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:47.006089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:47.007291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:47.007658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60a99d-ca08-41c4-906b-16a01efe9081 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.016771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 962/1898] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:47.017282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.017870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.018947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.019451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.019808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.020650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.022746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.027698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc010dc-4410-46ab-8148-95ce8f792519 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.032457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.033189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.033473 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.033748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.034469 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.036055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.046934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 963/1899] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:47.047730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.058057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfd536-ca7c-4799-8678-a92f78f8e231 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.062888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.063542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.066033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.066033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.066033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.066463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09caf0c-ac5e-4a73-bf3e-cf12745b48bd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.076597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 964/1900] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:47.078126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.078408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.078683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.097543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:47.098775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:47.108114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 965/1901] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:47.108924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.118526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2f633-9400-42b1-9be7-50535bdcae2f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.123779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.124690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.124965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.125233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] PATH_INFO: `/v3/projects/8cbed34733c0413e814b11600eb5fc43/users/88564b6c7b4a4c119d2197fd9405700b/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.130665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:47.141953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 937/1902] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:46 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:47.141953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.142228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbed34733c0413e814b11600eb5fc43, user_id=88564b6c7b4a4c119d2197fd9405700b, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.143327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.151985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537bc2-464e-4522-adce-e9b6a59429f7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.156958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.157638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.157925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.158198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.158921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.161138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.174090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 938/1903] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:47.175238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.185878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337546-54a2-4c00-a0e1-bec4d053bc49 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.190612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.191252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.191535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.191833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.192582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:47.192889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.194481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.208351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 939/1904] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:47.208351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.218073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2601-275f-4af6-9bc4-f0f1a810307e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.222761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.223397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.223676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.223950 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.224691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.226298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.236157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 940/1905] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:47.241623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.246448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffc57-9c7b-492c-aad4-b1e4d4244fb0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.251280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.252164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.252485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.252755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] PATH_INFO: `/v3/projects/92d4f43052684395ab46924f5667ab45/users/918ba5817d4d4157a9819b7e11344027/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.267461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d4f43052684395ab46924f5667ab45, user_id=918ba5817d4d4157a9819b7e11344027, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.270148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.294516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 966/1906] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:47 2022] PUT /identity/v3/projects/8cbed34733c0413e814b11600eb5fc43/users/88564b6c7b4a4c119d2197fd9405700b/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:47.295845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.379306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 941/1907] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:47 2022] PUT /identity/v3/projects/92d4f43052684395ab46924f5667ab45/users/918ba5817d4d4157a9819b7e11344027/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:47.380501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.381576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdfde-5757-4bb6-acba-d913ba8ab6dc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.454815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2714-bcaa-4469-8779-00b133ef5820 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.458376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.459166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.459466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.459748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.460519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.461961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.462527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443442-157d-41df-acd7-9d3143bcda5e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.462856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.463138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.463419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] PATH_INFO: `/v3/projects/8c9b64fe199e44cdba934fb5827bd75a/users/cb2ae70d3e25442f987c78a886013dff/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.484000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b64fe199e44cdba934fb5827bd75a, user_id=cb2ae70d3e25442f987c78a886013dff, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.486745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d937b6-7597-4933-8fac-9c5bf3ae3bdb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.621617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 942/1908] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:47 2022] PUT /identity/v3/projects/8c9b64fe199e44cdba934fb5827bd75a/users/cb2ae70d3e25442f987c78a886013dff/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:47.626276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.626408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 967/1909] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/projects => generated 367 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:47.626842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.626842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.626974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.626974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.626974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.650071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] MFA Rules not processed for user `88564b6c7b4a4c119d2197fd9405700b`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:47.651287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:47.652977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] MFA Rules not processed for user `918ba5817d4d4157a9819b7e11344027`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:47.654317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:47.716162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 943/1910] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:47.717243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.718745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 968/1911] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:47.719941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.793516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e88ff4-4506-4f89-a527-2cf78f3892fd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.796020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38c8b-35de-4214-a3f4-22766110543a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.798865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.799545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.799892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.800452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.800716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.801144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.801376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.809755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.809755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.809755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.810003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.810077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.816249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 944/1912] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:47.816249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.826311 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa688d-7819-4250-9700-3ae688c3c4a8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.831796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.832559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.836453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.836453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.836453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.836453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:47.930598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 969/1913] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:47.931524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:47.941769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077a18-7b6e-4cc4-aa22-9fb36e1a3ab2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:47.947187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:47.948020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:47.948123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:47.948448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:47.949091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:47.951185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.020263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 945/1914] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:48.021163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.092340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 970/1915] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:47 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:48.093629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.097043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab937-dffa-45cc-a04c-f63606cb3c58 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.162590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.163494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.163778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.164055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] PATH_INFO: `/v3/projects/8c9b64fe199e44cdba934fb5827bd75a/users/cb2ae70d3e25442f987c78a886013dff/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.166452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b64fe199e44cdba934fb5827bd75a, user_id=cb2ae70d3e25442f987c78a886013dff, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.166575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adc1b-6ea6-4d6e-9d4d-5eef9a32b20c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.169531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.172567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.173248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.173789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.173922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.174674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.177299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.190197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 971/1917] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:48.191070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.192889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 946/1917] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:48 2022] PUT /identity/v3/projects/8c9b64fe199e44cdba934fb5827bd75a/users/cb2ae70d3e25442f987c78a886013dff/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:48.196876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.202654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342937a-aa22-4968-930a-8c6324a368d9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.270645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36315024-5e5d-4984-9c8f-a838ebafb2ef admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.271718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.272665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.273120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.273559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.275547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.277020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.277520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31190d1d-5836-43ae-a660-b7ca26e55c1f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.277738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.278022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.278291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.278976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.280953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.419611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 972/1918] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:48 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:48.419611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.419611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.419611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.423497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 947/1919] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:48 2022] POST /identity/v3/users => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:48.423497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.441439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab799b-8bf0-41c8-bcff-39dd3ff4acb9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.447429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.447855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.448539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.448539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.459722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.459722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.460110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] MFA Rules not processed for user `cb2ae70d3e25442f987c78a886013dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:48.460110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:48.469002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 948/1920] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:48.469002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.479104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea66b-577b-48fb-8675-2ac4b739711f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.484100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.488964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.488964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.488964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.488964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.488964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.498477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 949/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:48.501237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.514225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5996077-dd3e-4363-8874-ea48c901d49c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.522791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.522791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.522791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.522791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.523122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.525580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.538622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 950/1922] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:48.539746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.540861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 973/1923] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:48.541770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.552023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83f80d-6466-4d2d-b462-22d87b0f0dfd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.552371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e82a1-b858-4843-8073-326a3b5da884 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.557364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.557533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.558252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.558368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.558553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.558663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.558827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] PATH_INFO: `/v3/projects/ae6b8325464947e0a9ead17758dfad8e/users/55d4c8191d614ef486e863303f73fe9b/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.558952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] PATH_INFO: `/v3/projects/e05ea03d3f2447b08de938e1afa9e740/users/2ac1d431ddc34e6981179396480caea9/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.574701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6b8325464947e0a9ead17758dfad8e, user_id=55d4c8191d614ef486e863303f73fe9b, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.575293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05ea03d3f2447b08de938e1afa9e740, user_id=2ac1d431ddc34e6981179396480caea9, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.577714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.578316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44e339-74ab-47b0-a496-74afd25ebe39 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.719839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 951/1924] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:48 2022] PUT /identity/v3/projects/ae6b8325464947e0a9ead17758dfad8e/users/55d4c8191d614ef486e863303f73fe9b/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:48.720671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.768667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 974/1925] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:48 2022] PUT /identity/v3/projects/e05ea03d3f2447b08de938e1afa9e740/users/2ac1d431ddc34e6981179396480caea9/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:48.770896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.771192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.771587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.784822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638d13-ed80-4ce7-a62d-05d37bdc381f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.799491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] MFA Rules not processed for user `55d4c8191d614ef486e863303f73fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:48.800781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:48.844541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.845410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.845684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.845957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] PATH_INFO: `/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01/users/8aed8cd0b6cf49de927c6549d4aae16d/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.857276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:48.860762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3d460b8e4b47dea7d4b0b9f7432b01, user_id=8aed8cd0b6cf49de927c6549d4aae16d, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.863600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.868543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 975/1926] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:48.869525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.880040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acdcb0-784e-4521-905c-9d17289cd0aa None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.885207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.885848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.886129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.886401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.887114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.888734 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.898536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 976/1927] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:48.899331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.911567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f0bd-cbee-435a-992c-1dc8808a1d99 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.916534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.917195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.917467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.917737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.918420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.920321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.993567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 952/1928] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:48 2022] PUT /identity/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01/users/8aed8cd0b6cf49de927c6549d4aae16d/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:48.994535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.026423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 977/1929] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:48 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:49.028338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.060271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2f1f1-b2d1-44c1-bd06-85617eee46b0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.096814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1bb5b-d770-45f1-85a2-781f51f1f6f7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.101671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.102392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.102683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.103021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.103728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.105350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.115608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 978/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:49.116483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.116645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.117365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.117645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.117922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] PATH_INFO: `/v3/projects/e05ea03d3f2447b08de938e1afa9e740/users/2ac1d431ddc34e6981179396480caea9/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.120669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05ea03d3f2447b08de938e1afa9e740, user_id=2ac1d431ddc34e6981179396480caea9, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.123818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.127381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fd7f-b769-462c-8fc3-049e338c98ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.132448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.132972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.133307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.133527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.134771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.146192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 953/1931] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:48 2022] PUT /identity/v3/projects/e05ea03d3f2447b08de938e1afa9e740/users/2ac1d431ddc34e6981179396480caea9/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:49.146192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.146343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98553-1832-4e4f-8961-569dc965e87b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.208765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af5b6-1762-441d-800f-e75309adb37e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.214574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.215475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.215764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.216038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] PATH_INFO: `/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01/users/8aed8cd0b6cf49de927c6549d4aae16d/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.218210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3d460b8e4b47dea7d4b0b9f7432b01, user_id=8aed8cd0b6cf49de927c6549d4aae16d, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.221216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.232861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 954/1932] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:49 2022] PUT /identity/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01/users/8aed8cd0b6cf49de927c6549d4aae16d/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:49.233874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.235561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:49.267133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 979/1933] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:49 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:49.272063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.272488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.272841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.312047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57673-3fd1-44bb-af89-fac2d21d4472 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.324367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.326141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.326233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] MFA Rules not processed for user `2ac1d431ddc34e6981179396480caea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:49.326333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.326333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.328069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:49.426566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.428392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e735e4-c1fc-45da-b26e-dc31562fedd1 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.442747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 955/1934] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:49.444813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.445291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.445745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.470493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 980/1935] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:49.471752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.483784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] MFA Rules not processed for user `8aed8cd0b6cf49de927c6549d4aae16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:49.485323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:49.596242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 956/1936] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:49.600067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c347e-ada9-474e-964c-1bb717f351ef None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.602866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.605575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.606262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.606677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:49.613614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.619217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.620089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.629974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.630065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00588-8c0d-4900-bddd-7afaa44abec8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.635491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.636160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.636508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.636821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.639697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 981/1937] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:49.640692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.650612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.651714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d014-9b55-4009-8d93-e0725b9f3250 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.652243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.657943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.659728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.659728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.659728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] PATH_INFO: `/v3/projects/cadf19477d2046379b56ffca48fe7514/users/c6597135fb5e40008432f3cff42a9c3d/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.667356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 957/1938] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:49.677195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadf19477d2046379b56ffca48fe7514, user_id=c6597135fb5e40008432f3cff42a9c3d, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.681001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.747088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:49.757164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.768645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf5b9-1cdb-4863-9ecd-9aa8f7c8cdc0 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.773761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.775123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.775490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.775836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] PATH_INFO: `/v3/users/2b1da2404fad405f83f4086116736bc9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.777156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1da2404fad405f83f4086116736bc9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.779193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.784412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 982/1939] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:49 2022] PUT /identity/v3/projects/cadf19477d2046379b56ffca48fe7514/users/c6597135fb5e40008432f3cff42a9c3d/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:49.787983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:49.848993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200e50e-b517-47f6-8a55-0854b15095d4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:49.852675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:49.853316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:49.853597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:49.853871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:49.917572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:49.919035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:49.929480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 983/1940] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:49.930323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.008415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b4ff4-0d96-4858-85c1-9299d8896eda service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.015311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.016307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.016588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.016860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.017589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.019432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.030977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 984/1941] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:50.031671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.046840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7da3c-c45e-40b6-9370-7d7dafd3111e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.050942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.051599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.051877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.052148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.056472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1da2404fad405f83f4086116736bc9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:50.069985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1da2404fad405f83f4086116736bc9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:50.071222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1da2404fad405f83f4086116736bc9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:50.072401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1da2404fad405f83f4086116736bc9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:50.081213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9df080d2-53ba-4044-8498-25812a38e7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1da2404fad405f83f4086116736bc9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:50.119400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.120888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.130720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 985/1942] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:50.131592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.143679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655568f5-0c12-4f21-80e9-e7d6250917bd service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.149103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.150079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.150278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.150651 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] PATH_INFO: `/v3/projects/cadf19477d2046379b56ffca48fe7514/users/c6597135fb5e40008432f3cff42a9c3d/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.152761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadf19477d2046379b56ffca48fe7514, user_id=c6597135fb5e40008432f3cff42a9c3d, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.155415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a4e1-c323-47f9-8f75-7391fa722422 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.166977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 986/1943] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:50 2022] PUT /identity/v3/projects/cadf19477d2046379b56ffca48fe7514/users/c6597135fb5e40008432f3cff42a9c3d/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:50.178665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.178953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.179234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.208303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 958/1944] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:49 2022] DELETE /identity/v3/users/2b1da2404fad405f83f4086116736bc9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:50.212541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.213220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.213700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.219966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] MFA Rules not processed for user `c6597135fb5e40008432f3cff42a9c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:50.221261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:50.239724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:50.241455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:50.302208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 987/1945] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:50.343352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 959/1946] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:50.353930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.355510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:50.418674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c3aa5-8fd8-4c8d-b99f-e0ca028e579e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.422552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.423897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.423897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.423897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.438911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.440422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.450628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 988/1947] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:50.483092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.484714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:50.570295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135df10-6234-4534-9c0b-d898d03f131a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.574544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.575222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.575485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.575757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.585581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.587536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.597002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 960/1948] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:51.175359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:51.175359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:51.178863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0deed-6b15-49a7-8b53-6b2f4f950b3e service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:51.185919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:51.186974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:51.187357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:51.187733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] PATH_INFO: `/v3/projects/51d145fccd464ac39676a7eafbd08934` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:51.190201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d145fccd464ac39676a7eafbd08934)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:51.197744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:51.384148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d145fccd464ac39676a7eafbd08934', 'request_id': 'req-6cb87513-0fa9-485e-8d79-28256303b9e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.495641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d145fccd464ac39676a7eafbd08934', 'request_id': 'req-6cb87513-0fa9-485e-8d79-28256303b9e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.504409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d145fccd464ac39676a7eafbd08934', 'request_id': 'req-6cb87513-0fa9-485e-8d79-28256303b9e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.516655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] The token cache is being invalidate because project 51d145fccd464ac39676a7eafbd08934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:51.516924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.518058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.520035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 989/1949] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:51 2022] DELETE /identity/v3/projects/51d145fccd464ac39676a7eafbd08934 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:51.524114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:51.536633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8a4f-a65f-44aa-b957-149eb2de07bd service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:51.632173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:51.633249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:51.634162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:51.634627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] PATH_INFO: `/v3/users/cb2ae70d3e25442f987c78a886013dff` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:51.636027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2ae70d3e25442f987c78a886013dff)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:51.638317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:51.952942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2ae70d3e25442f987c78a886013dff'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.966999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2ae70d3e25442f987c78a886013dff'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.968225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2ae70d3e25442f987c78a886013dff'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.968880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2ae70d3e25442f987c78a886013dff'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.977213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2ae70d3e25442f987c78a886013dff'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:51.991893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:52.003527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:52.027879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:52.091760 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87513-0fa9-485e-8d79-28256303b9e3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:52.097815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:52.099023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:52.100511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:52.101201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:52.101465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 961/1950] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:51 2022] DELETE /identity/v3/users/cb2ae70d3e25442f987c78a886013dff => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:52.105052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:52.108809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:52.127508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:52.215321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a4dff-bee8-4e9e-9d2e-8b509b6fe6a8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:52.221163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac1d431ddc34e6981179396480caea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05ea03d3f2447b08de938e1afa9e740', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:52.221335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:52.221871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:52.222122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:52.222400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:52.223133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:52.223231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:52.223439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:52.225243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:52.237554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 990/1951] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:52.239188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 962/1952] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:52.243754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:52.323732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6339e-4557-4129-9709-fb6575021c3a service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:52.329248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac1d431ddc34e6981179396480caea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05ea03d3f2447b08de938e1afa9e740', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:52.330008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:52.330365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:52.330717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:52.331493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:52.333511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:52.404481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:52.448758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 991/1953] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:52 2022] POST /identity/v3/projects => generated 353 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:52.454380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:52.466912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200aa5-642c-434e-97c2-11d773c60643 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:52.535004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac1d431ddc34e6981179396480caea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05ea03d3f2447b08de938e1afa9e740', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:52.536043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:52.536438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:52.536723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:52.537457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:52.537792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:52.540553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:52.557711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 963/1954] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:52.706735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:52.710162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:52.806713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da60e-c793-4d3c-94e3-684736762802 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:52.824000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:52.825030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:52.825304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:52.825613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] PATH_INFO: `/v3/projects/8c9b64fe199e44cdba934fb5827bd75a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:52.826957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9b64fe199e44cdba934fb5827bd75a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:52.829352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:52.953718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9b64fe199e44cdba934fb5827bd75a', 'request_id': 'req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.059764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.071228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de30df7-10f0-441a-89cc-b9de82de77e3 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.090440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9b64fe199e44cdba934fb5827bd75a', 'request_id': 'req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.100053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9b64fe199e44cdba934fb5827bd75a', 'request_id': 'req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.115282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] The token cache is being invalidate because project 8c9b64fe199e44cdba934fb5827bd75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:53.115971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.116828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d6dace0a-71f4-4ad8-b1c5-cf6635d5386e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.119532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 992/1955] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:52 2022] DELETE /identity/v3/projects/8c9b64fe199e44cdba934fb5827bd75a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:53.124705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5ec1-c6d0-486e-84f7-fb1a03864968 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.125137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5ec1-c6d0-486e-84f7-fb1a03864968 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.125518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5ec1-c6d0-486e-84f7-fb1a03864968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.137938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ac1d431ddc34e6981179396480caea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05ea03d3f2447b08de938e1afa9e740', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.139190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.139665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.139972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] PATH_INFO: `/v3/projects/0f0b7471f3a1461da3104375dca76827` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.141595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f0b7471f3a1461da3104375dca76827)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.143858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.154020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f95b5ec1-c6d0-486e-84f7-fb1a03864968 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:53.156313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f95b5ec1-c6d0-486e-84f7-fb1a03864968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:53.167893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:53.234286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 993/1956] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:53.241850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.242132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.242408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.260808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:53.261986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:53.270136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 994/1957] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:53.275028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.283833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363af92-71f5-4854-98ce-41301acc4c30 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.288444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.289081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.289359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.289632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.290940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:53.291242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.292869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.304066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 995/1958] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:19:53.309089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.319338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72a93f-31dc-4234-9a49-d2a09fd9e331 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.327938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.340494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.340898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.341218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.341966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.344362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.361517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0b7471f3a1461da3104375dca76827', 'request_id': 'req-49effd46-2a51-490a-8240-2fb1ff426c88'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.448766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0b7471f3a1461da3104375dca76827', 'request_id': 'req-49effd46-2a51-490a-8240-2fb1ff426c88'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.460657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 996/1959] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:53 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:53.461961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0b7471f3a1461da3104375dca76827', 'request_id': 'req-49effd46-2a51-490a-8240-2fb1ff426c88'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.462170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.524831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] The token cache is being invalidate because project 0f0b7471f3a1461da3104375dca76827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:53.525163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.527228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:53.530840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 964/1960] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:53 2022] DELETE /identity/v3/projects/0f0b7471f3a1461da3104375dca76827 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:53.577124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c302-9b4d-4ed2-9321-95cc2a224bdf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.583830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.584886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.585482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.585950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.587449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.590090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.777686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 997/1961] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:53 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:53.784377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.786435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:53.851307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49effd46-2a51-490a-8240-2fb1ff426c88 tempest-VolumeQuotaClassesTest-1615290988 tempest-VolumeQuotaClassesTest-1615290988-project-admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.856427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.857104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.857371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.857635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.858342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.859968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.872827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 965/1962] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:53.874720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.886466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c145ea-8811-41f9-a33e-622d79383906 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.891340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.892009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.892338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.892625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.893351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.894975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad1ef3-ddc2-46b7-9c23-032f83fe084b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:53.905969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 998/1963] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:53.913778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:53.924097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577fec4-f66e-4a4a-b564-725a48ad2612 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:53.928780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:53.929659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:53.929939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:53.930215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] PATH_INFO: `/v3/projects/29824f2f923f4c3399c41b71e20b0b5b/users/c020f5da8c1f42a2bfb5ed9a01c17c31/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:53.945500 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29824f2f923f4c3399c41b71e20b0b5b, user_id=c020f5da8c1f42a2bfb5ed9a01c17c31, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:53.948680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.101994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 966/1964] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:53 2022] PUT /identity/v3/projects/29824f2f923f4c3399c41b71e20b0b5b/users/c020f5da8c1f42a2bfb5ed9a01c17c31/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:54.113423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.113712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.114084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.144931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] MFA Rules not processed for user `c020f5da8c1f42a2bfb5ed9a01c17c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:54.146348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:54.219656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 999/1965] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:54.228580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:54.303737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6aa3-0dd2-4a63-b091-6f588192031e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:54.309519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:54.309709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.309991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.310264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.311168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:54.313036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.394284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 967/1966] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:54 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:54.400693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:54.416138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1aed-f2a8-4125-bd21-3e8e0630e6fd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:54.475423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:54.476177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.476488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.476763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.477480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:54.479682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.578617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1000/1967] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:54 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:54.582742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:54.595679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61f7e-4667-47f2-8f6a-18c8a09078c8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:54.600518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:54.601179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.601468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.601853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.602506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:54.604137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.615200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 968/1968] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:19:54.619734 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:54.630335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaff94d-5e23-400d-b80d-ecda12da053e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:54.635739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:54.645644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.645644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.645644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.645644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:54.645644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c061f5d-0af5-4cfb-a34b-32160d7551fd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.650618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1001/1969] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:54.655285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:54.665881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559d9c-30e1-463e-9e07-29ec1b43220e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:54.670553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:54.671481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.671762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.672039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] PATH_INFO: `/v3/projects/dd82faaee4d6458f867811a46cbd4a45/users/de3b7838c67f4633907a3c8fc1e00c05/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.687864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd82faaee4d6458f867811a46cbd4a45, user_id=de3b7838c67f4633907a3c8fc1e00c05, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:54.690927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:54.827332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 969/1970] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:54 2022] PUT /identity/v3/projects/dd82faaee4d6458f867811a46cbd4a45/users/de3b7838c67f4633907a3c8fc1e00c05/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:54.837635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:54.837924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:54.838201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:54.866279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] MFA Rules not processed for user `de3b7838c67f4633907a3c8fc1e00c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:54.867416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:54.938237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1002/1971] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:54.942641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.011458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0ede7-8328-433e-88c9-e56f50c76685 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.016623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.017286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.017611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.017960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.018639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.020668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.153029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 970/1972] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:54 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:55.163347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.174845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddec69-4db3-4e44-b45e-dd16988de1fd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.240426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.241092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.241376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.241649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.242332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.244290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.248524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:55.392056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1003/1973] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:55 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:55.392322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.396133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963b2-7878-4541-a996-b720be2ef5f2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.401375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.402064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.402352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.402620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.403431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.405087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.410063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:55.416060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 971/1974] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:55.429731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.441490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09355-637b-4268-a5d3-abf84d7fa07f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.447739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.448829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.449191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.449534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] PATH_INFO: `/v3/projects/e1fb8937dede4aa793b98bf04235032d/users/32a5c3306cd1476ab462c0d3ff1a7db5/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.468269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fb8937dede4aa793b98bf04235032d, user_id=32a5c3306cd1476ab462c0d3ff1a7db5, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.471013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.498023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.503898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:55.518324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6fa70-d03d-4590-943b-8a4c51a9aed5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.523590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.525150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.525502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.525901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] PATH_INFO: `/v3/users/88564b6c7b4a4c119d2197fd9405700b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.527154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88564b6c7b4a4c119d2197fd9405700b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.529303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.595005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1004/1975] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:55 2022] PUT /identity/v3/projects/e1fb8937dede4aa793b98bf04235032d/users/32a5c3306cd1476ab462c0d3ff1a7db5/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:55.599200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.667662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d43a-538a-4535-b4c2-21dfdf07c3e2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.672359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.673024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.673302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.673574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.674288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.675859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.686287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1005/1976] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:19:55.690160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:55.700690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9289db-c2bf-4f8d-80a6-d59aa5a14e62 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:55.706039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:55.707021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.707342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.707624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] PATH_INFO: `/v3/projects/e1fb8937dede4aa793b98bf04235032d/users/32a5c3306cd1476ab462c0d3ff1a7db5/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.709693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fb8937dede4aa793b98bf04235032d, user_id=32a5c3306cd1476ab462c0d3ff1a7db5, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:55.713090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62e4ca-78c6-4670-8dc4-a4be486aefa6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:55.724414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1006/1977] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:55 2022] PUT /identity/v3/projects/e1fb8937dede4aa793b98bf04235032d/users/32a5c3306cd1476ab462c0d3ff1a7db5/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:55.735080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764268-9e16-430f-9dd8-201223e5a5a8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.735374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764268-9e16-430f-9dd8-201223e5a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.735646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764268-9e16-430f-9dd8-201223e5a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.762839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1a764268-9e16-430f-9dd8-201223e5a5a8 None None] MFA Rules not processed for user `32a5c3306cd1476ab462c0d3ff1a7db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:55.764134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1a764268-9e16-430f-9dd8-201223e5a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:55.814539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88564b6c7b4a4c119d2197fd9405700b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:55.830266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88564b6c7b4a4c119d2197fd9405700b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:55.832113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88564b6c7b4a4c119d2197fd9405700b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:55.832959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88564b6c7b4a4c119d2197fd9405700b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:55.840972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88564b6c7b4a4c119d2197fd9405700b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:55.842013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1007/1978] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:55.970256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 972/1979] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:55 2022] DELETE /identity/v3/users/88564b6c7b4a4c119d2197fd9405700b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:55.972490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:55.972821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:55.973101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:55.994465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:55.995739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.007895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:56.010212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.056569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1008/1980] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:56.066278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:56.067633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.074371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da83a-89c0-4b29-af85-35883d31e17c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:56.078652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:56.079332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:56.079620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:56.079895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:56.081798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.124911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5064-da25-48fa-abd5-78a61a525476 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:56.128679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:56.129327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:56.129610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:56.129885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:56.147236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:56.148722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:56.149332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:56.151018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:56.158692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 973/1981] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:56.161561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1009/1982] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:56.533333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:56.543117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ca5d-3ad7-49a9-9ee8-a060e5ff97ea service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:56.551633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:56.552347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:56.552629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:56.552902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:56.555020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.628862 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:56.631779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:56.635833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:56.637452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:56.649667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 974/1983] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:56.650885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:56.663492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311c047-d137-4812-8ccc-6944c2497961 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:56.671522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:56.672739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:56.673272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:56.673687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] PATH_INFO: `/v3/projects/8cbed34733c0413e814b11600eb5fc43` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:56.675503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbed34733c0413e814b11600eb5fc43)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:56.688682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:56.730693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:56.844077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbed34733c0413e814b11600eb5fc43', 'request_id': 'req-4ad3c22a-36be-4aaa-b931-e039d5994ce8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:56.941946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbed34733c0413e814b11600eb5fc43', 'request_id': 'req-4ad3c22a-36be-4aaa-b931-e039d5994ce8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:56.953299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbed34733c0413e814b11600eb5fc43', 'request_id': 'req-4ad3c22a-36be-4aaa-b931-e039d5994ce8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:56.963521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] The token cache is being invalidate because project 8cbed34733c0413e814b11600eb5fc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:56.964083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:56.964774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:56.966434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1010/1984] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:56 2022] DELETE /identity/v3/projects/8cbed34733c0413e814b11600eb5fc43 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:56.972059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:56.983343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69320e-bd71-410c-a59b-3ba2b534b3aa service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:57.042677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:57.043561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:57.043872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:57.044146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] PATH_INFO: `/v3/users/2ac1d431ddc34e6981179396480caea9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:57.045464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac1d431ddc34e6981179396480caea9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:57.047429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:57.402857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac1d431ddc34e6981179396480caea9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:57.414881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac1d431ddc34e6981179396480caea9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:57.415617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac1d431ddc34e6981179396480caea9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:57.416238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac1d431ddc34e6981179396480caea9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:57.423072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f3709d56-fcac-40e5-99f8-b9eb96275778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac1d431ddc34e6981179396480caea9'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:57.529670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 975/1985] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:56 2022] DELETE /identity/v3/users/2ac1d431ddc34e6981179396480caea9 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:58.023742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:58.026179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:58.041818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3c22a-36be-4aaa-b931-e039d5994ce8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:58.098766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:58.100189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.100424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.100801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] PATH_INFO: `/v3/projects/e05ea03d3f2447b08de938e1afa9e740` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.102061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05ea03d3f2447b08de938e1afa9e740)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:58.104921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:58.165884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:58.343596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05ea03d3f2447b08de938e1afa9e740', 'request_id': 'req-05f82fdc-b03e-4c21-ab13-53bcc339b192'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:58.425474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05ea03d3f2447b08de938e1afa9e740', 'request_id': 'req-05f82fdc-b03e-4c21-ab13-53bcc339b192'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:58.434026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05ea03d3f2447b08de938e1afa9e740', 'request_id': 'req-05f82fdc-b03e-4c21-ab13-53bcc339b192'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:58.453767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] The token cache is being invalidate because project e05ea03d3f2447b08de938e1afa9e740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:19:58.454057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:58.454904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-05f82fdc-b03e-4c21-ab13-53bcc339b192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:58.457802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1011/1986] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:19:58 2022] DELETE /identity/v3/projects/e05ea03d3f2447b08de938e1afa9e740 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:58.463362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.463842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.464049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.483218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:58.484483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:58.548271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 976/1987] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:58.556369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.556809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.557299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.582985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:58.583952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:58.593497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1012/1988] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:58.597494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:58.607292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef833c6e-0e51-4d08-803a-30d1dec10c50 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:58.612742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:58.613485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.614066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.616988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.616988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:19:58.616988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:58.618313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:58.630185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 977/1989] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:19:58.635067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:58.644508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3e75f-027c-426d-b506-051caf080df4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:58.650163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:58.650863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.651142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.651475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.652180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:58.654134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:58.717568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:58.801120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1013/1990] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:58 2022] POST /identity/v3/projects => generated 407 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:58.805776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:58.817559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dd4d-461b-4349-8718-7c091ad51927 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:58.883035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:58.885022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:58.885316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:58.885665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:58.886377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:58.888339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:58.991927 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 978/1991] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:58 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:58.996701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.011513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d8f7-c337-43dd-8405-9b8ea66fa8f4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.024055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.024055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.024055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.024055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.025077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.025077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.037208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1014/1992] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:59.040521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.040521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:59.043528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.060139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b63-07fe-4ac5-9854-2de1095a675b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.064435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468c6c-556f-47fc-b2ba-259dcd2365ea admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.066681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.067470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.067756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.068140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.069295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.071989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.073808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.074706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.074984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.075253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] PATH_INFO: `/v3/users/918ba5817d4d4157a9819b7e11344027` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.079764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] RBAC: Authorizing `identity:delete_user(user_id=918ba5817d4d4157a9819b7e11344027)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.084436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.085396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1015/1993] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:59.089410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.101391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff439-dc57-4ff7-a31c-6952a4969277 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.108568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.109407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.109695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.109974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] PATH_INFO: `/v3/projects/107df6d14f39440eb301e4e073df569e/users/3c0dba91293848b9923f4778837b8500/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.126707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107df6d14f39440eb301e4e073df569e, user_id=3c0dba91293848b9923f4778837b8500, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.129706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae1855-977c-4afd-8b13-6ddbf6faef05 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.198610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:59.345813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1016/1994] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:59 2022] PUT /identity/v3/projects/107df6d14f39440eb301e4e073df569e/users/3c0dba91293848b9923f4778837b8500/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:59.355293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.355589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.355870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.382954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] MFA Rules not processed for user `3c0dba91293848b9923f4778837b8500`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:59.384097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:59.399931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918ba5817d4d4157a9819b7e11344027'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:59.412129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918ba5817d4d4157a9819b7e11344027'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:59.412945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918ba5817d4d4157a9819b7e11344027'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:59.413556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918ba5817d4d4157a9819b7e11344027'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:59.421879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3bf4e60-5659-48a2-8967-e2d730b9992d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918ba5817d4d4157a9819b7e11344027'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:19:59.466137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1017/1995] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:59.479393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.480787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:59.549696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df654c2-b51b-48c0-a254-ff53e659a364 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.556913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.557526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.557943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.558371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.559097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.561725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.564217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 979/1996] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:19:59 2022] DELETE /identity/v3/users/918ba5817d4d4157a9819b7e11344027 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:59.569548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.569919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.570271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.589341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:59.590546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:59.652618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 980/1997] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:59.662562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.663672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:59.669145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1018/1998] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:19:59 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:19:59.672997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.723963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb33d3-7756-4f31-aa86-fd55c7937660 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.734839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3aec7-1721-41cf-9da5-713c189149cd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.739510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.740532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.740532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.740784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.741519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.744027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.776010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.776722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.776995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.777266 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.786825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.788970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.799688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 981/1999] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:19:59.860635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1019/2000] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:19:59 2022] POST /identity/v3/users => generated 310 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:59.861835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.869956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:59.876590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35955fb-73d5-4ae0-b499-5776deea1af8 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.884853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.885528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.885813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.886088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.886809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.888491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:59.904271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 982/2001] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:59.910133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:59.922199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5005-fae2-4c55-a6ed-443d0545daab admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:59.928101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:59.929059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:59.929686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:59.929686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] PATH_INFO: `/v3/projects/7799482fdfa84f258b47682c681dca38/users/a43e44375be74efd8d3c996d9b3fb964/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:59.947143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:59.952087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7799482fdfa84f258b47682c681dca38, user_id=a43e44375be74efd8d3c996d9b3fb964, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:59.956275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.104331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1020/2002] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:19:59 2022] PUT /identity/v3/projects/7799482fdfa84f258b47682c681dca38/users/a43e44375be74efd8d3c996d9b3fb964/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:00.108506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.123667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e21954-7fae-468c-84e7-d62551cd8e96 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:00.198738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:00.199413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.199694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.199974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.200719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:00.202424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194eee-18b5-4325-a351-ef281a794d41 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.214210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 983/2003] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:00.218698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.229761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f95d0-e550-490f-8782-4410e7babc20 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:00.234620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:00.235510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.235838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.236078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] PATH_INFO: `/v3/projects/7799482fdfa84f258b47682c681dca38/users/a43e44375be74efd8d3c996d9b3fb964/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.238072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7799482fdfa84f258b47682c681dca38, user_id=a43e44375be74efd8d3c996d9b3fb964, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:00.240814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.252627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1021/2004] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:00 2022] PUT /identity/v3/projects/7799482fdfa84f258b47682c681dca38/users/a43e44375be74efd8d3c996d9b3fb964/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:00.264167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636a08-9675-4d21-8702-8da966503515 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.264485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636a08-9675-4d21-8702-8da966503515 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.264873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636a08-9675-4d21-8702-8da966503515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.294504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1b636a08-9675-4d21-8702-8da966503515 None None] MFA Rules not processed for user `a43e44375be74efd8d3c996d9b3fb964`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:00.295702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1b636a08-9675-4d21-8702-8da966503515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:00.348595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.350593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:00.374473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 984/2005] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:00.388633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636a08-9675-4d21-8702-8da966503515 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.388633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1b636a08-9675-4d21-8702-8da966503515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:00.428289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd400-1061-4985-b0fb-de700858324f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:00.433584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:00.434448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.434727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.434999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] PATH_INFO: `/v3/projects/92d4f43052684395ab46924f5667ab45` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.436175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d4f43052684395ab46924f5667ab45)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:00.438111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.449708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636a08-9675-4d21-8702-8da966503515 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:00.453981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:00.454626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.454904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.455172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.464532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:00.466061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.475861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 985/2006] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:00.599603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d4f43052684395ab46924f5667ab45', 'request_id': 'req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:00.711563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d4f43052684395ab46924f5667ab45', 'request_id': 'req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:00.719126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d4f43052684395ab46924f5667ab45', 'request_id': 'req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:00.733871 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] The token cache is being invalidate because project 92d4f43052684395ab46924f5667ab45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:00.734246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:00.734827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:00.739398 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1022/2007] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:00 2022] DELETE /identity/v3/projects/92d4f43052684395ab46924f5667ab45 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:00.740687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.757667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568d8b-7b39-4474-bfb5-72fb98afb049 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:00.811450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:00.812395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:00.812791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:00.812964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] PATH_INFO: `/v3/users/8aed8cd0b6cf49de927c6549d4aae16d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:00.814225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aed8cd0b6cf49de927c6549d4aae16d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:00.816414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:00.946301 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:00.985885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:00.987388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:01.053880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc094bb9-b4ca-4ff4-a148-b5108ab67e63 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:01.057772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:01.061377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:01.061377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:01.061377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:01.061377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:01.066642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aed8cd0b6cf49de927c6549d4aae16d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:01.080426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aed8cd0b6cf49de927c6549d4aae16d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:01.081168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aed8cd0b6cf49de927c6549d4aae16d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:01.081814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aed8cd0b6cf49de927c6549d4aae16d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:01.089859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02740385-484f-4cf5-9db2-1b3a86cfe25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aed8cd0b6cf49de927c6549d4aae16d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:01.129143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:01.131861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:01.146901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1023/2008] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:01.259486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 986/2009] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:00 2022] DELETE /identity/v3/users/8aed8cd0b6cf49de927c6549d4aae16d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:01.359286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:01.811693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:01.813381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:01.830501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78239b-e5d1-4b36-8c2b-ca32e7fc21d0 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:01.887597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:01.888559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:01.888847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:01.889122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] PATH_INFO: `/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:01.890306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3d460b8e4b47dea7d4b0b9f7432b01)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:01.892295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.077352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3d460b8e4b47dea7d4b0b9f7432b01', 'request_id': 'req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.254349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3d460b8e4b47dea7d4b0b9f7432b01', 'request_id': 'req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.263195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3d460b8e4b47dea7d4b0b9f7432b01', 'request_id': 'req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.287633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] The token cache is being invalidate because project 9a3d460b8e4b47dea7d4b0b9f7432b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:02.288065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.289086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a645e88f-6ad4-4e64-9b2a-b019d4a9c23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.297195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1024/2010] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:01 2022] DELETE /identity/v3/projects/9a3d460b8e4b47dea7d4b0b9f7432b01 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:02.299014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.300284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.300284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.319627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:02.321611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:02.392392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 987/2011] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:02.400889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.401185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.401468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.422730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:02.423830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:02.432853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1025/2012] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:02.437123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.448471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd830dc1-9bbd-49cb-998e-7a8092e4c695 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.454439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.455185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.455526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.455800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.456767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:02.457255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.459131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.476898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 988/2013] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:20:02.480041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.489376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c496755-052d-49bf-b910-4a8591074d2d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.495068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.495722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.496010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.496318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.497025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.498916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.579936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.581694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:02.594230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:02.595419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c820ee-cf7a-4af4-8aec-d0657b8f8171 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.601381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.602334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.602640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.603133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] PATH_INFO: `/v3/users/c020f5da8c1f42a2bfb5ed9a01c17c31` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.604813 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c020f5da8c1f42a2bfb5ed9a01c17c31)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.606889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.681414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1026/2014] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:02 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:02.685540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.761971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc945ba-8a5d-496d-b89d-3303638b6629 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.767063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.767771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.768077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.770593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.770593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.771035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.808852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c020f5da8c1f42a2bfb5ed9a01c17c31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.824674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c020f5da8c1f42a2bfb5ed9a01c17c31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.825472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c020f5da8c1f42a2bfb5ed9a01c17c31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.826090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c020f5da8c1f42a2bfb5ed9a01c17c31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.834749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c020f5da8c1f42a2bfb5ed9a01c17c31'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:02.886593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1027/2015] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:02 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:02.886593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.886593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:02.898462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5212-3db8-42a7-836d-4035fa1909ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.908904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.911308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.911308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.911308 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] PATH_INFO: `/v3/users/55d4c8191d614ef486e863303f73fe9b` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.914493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d4c8191d614ef486e863303f73fe9b)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.915085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 989/2016] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:02 2022] DELETE /identity/v3/users/c020f5da8c1f42a2bfb5ed9a01c17c31 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:02.915260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:02.916858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:02.918962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:02.988004 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46ef2-62b4-4ebc-8ee4-9b9319c75b0c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:02.993352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:02.994041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:02.994323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:02.994599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:02.995325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:02.996989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29750319-9bf0-4a35-9fda-c92f87b2d8ce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.007037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 990/2017] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:03.008489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.008800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.009080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.026149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:03.027506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.035976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 991/2018] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:03.037013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.047408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12e23-4bd3-47e8-b164-d0095d0f82e9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.052826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.053506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.053816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.054096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.054824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.057046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.071024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 992/2019] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:03.071024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.071024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.128224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3ac4-f679-455f-9e54-1e981b8f07a3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.132103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.132840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.133118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.133390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.143059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.144870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.154351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 993/2020] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:03.155145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.164424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f1d9-235d-481d-a0f3-45a6c8decde4 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.171190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.172636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.172636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.172809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] PATH_INFO: `/v3/projects/60fd44b5a21044a9b1b4abf80e6d5614/users/3b24196474724b80800b3949c4f53e50/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.192949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fd44b5a21044a9b1b4abf80e6d5614, user_id=3b24196474724b80800b3949c4f53e50, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.196769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195927-7b3d-41d8-8b91-2797b3c40188 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.208503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d4c8191d614ef486e863303f73fe9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:03.234823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d4c8191d614ef486e863303f73fe9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:03.243795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d4c8191d614ef486e863303f73fe9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:03.245087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d4c8191d614ef486e863303f73fe9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:03.245967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1d4314c1-0930-45be-aa10-122d7eb205bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d4c8191d614ef486e863303f73fe9b'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:03.351732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 994/2021] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:03 2022] PUT /identity/v3/projects/60fd44b5a21044a9b1b4abf80e6d5614/users/3b24196474724b80800b3949c4f53e50/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:03.363616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.363903 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.364175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.402531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] MFA Rules not processed for user `3b24196474724b80800b3949c4f53e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:03.403418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1028/2022] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:02 2022] DELETE /identity/v3/users/55d4c8191d614ef486e863303f73fe9b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:03.407001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.408287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.408579 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.408848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.442689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:03.444108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.492740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 995/2023] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:03.497551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.499557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.511122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:03.515606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1029/2024] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:03.534321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.535776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.662870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475f199-1143-4e7f-a16b-6e3984c540f9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.671012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.671538 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760321bd-e84a-4a46-ba48-480878c996e0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.672297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.672814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.673283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.674368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.676637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.677849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.678805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.679233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.679806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.693407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.695165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:03.707606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1030/2025] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:03.866487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 996/2026] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:03 2022] POST /identity/v3/projects => generated 381 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:03.867528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.879513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:03.881367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:03.882556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487fce-bb65-4540-a0ef-a3d267e7db6e service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:03.978544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:03.979770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:03.980156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:03.980562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:03.981429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:03.983645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.001386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6135f6-51bf-489b-ac97-e5d9c66edf5e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.006245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.007119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.007401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.007675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] PATH_INFO: `/v3/projects/29824f2f923f4c3399c41b71e20b0b5b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.009024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29824f2f923f4c3399c41b71e20b0b5b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.011032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.069187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1031/2027] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:03 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:04.073928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:04.085085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba643e-5a1f-4c80-b996-187797958e28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.090806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.091535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.091822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.092100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.092860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.094583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.105713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1032/2028] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:04.113454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:04.127221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb856d5-6de6-4304-a1a1-441964c39af8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.132626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.133657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.133943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.134434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] PATH_INFO: `/v3/projects/693520ccf8c043e8b653e5794d819c08/users/138e1f0fdecc43b2a63ba56cde0d7e29/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.142866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29824f2f923f4c3399c41b71e20b0b5b', 'request_id': 'req-561aea71-d5a2-442b-944e-c440c6533452'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.151102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693520ccf8c043e8b653e5794d819c08, user_id=138e1f0fdecc43b2a63ba56cde0d7e29, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.160254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.305322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29824f2f923f4c3399c41b71e20b0b5b', 'request_id': 'req-561aea71-d5a2-442b-944e-c440c6533452'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.312541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29824f2f923f4c3399c41b71e20b0b5b', 'request_id': 'req-561aea71-d5a2-442b-944e-c440c6533452'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.323351 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] The token cache is being invalidate because project 29824f2f923f4c3399c41b71e20b0b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:04.323685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.324387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.325992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 997/2029] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:03 2022] DELETE /identity/v3/projects/29824f2f923f4c3399c41b71e20b0b5b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:04.330209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:04.331544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:04.405953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aea71-d5a2-442b-944e-c440c6533452 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.412097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1033/2030] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:04 2022] PUT /identity/v3/projects/693520ccf8c043e8b653e5794d819c08/users/138e1f0fdecc43b2a63ba56cde0d7e29/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:04.414253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:04.415982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:04.513680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.514727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.515012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.515282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] PATH_INFO: `/v3/users/de3b7838c67f4633907a3c8fc1e00c05` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.516594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3b7838c67f4633907a3c8fc1e00c05)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.518614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.530987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052f9a-c397-4e9b-a24b-710194f95101 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.541609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.542297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.542581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.542858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.543623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.545290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.557810 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1034/2031] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:04.558933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:04.562944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:04.577384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abf0c-330b-4bf3-a43e-58d6656c5a9e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:04.585389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:04.587336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:04.587629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:04.587906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] PATH_INFO: `/v3/projects/ae6b8325464947e0a9ead17758dfad8e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:04.589563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6b8325464947e0a9ead17758dfad8e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:04.591728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:04.746144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:04.827266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6b8325464947e0a9ead17758dfad8e', 'request_id': 'req-c68ca84a-9f9f-40d9-8f94-3474264c6b80'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.828933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3b7838c67f4633907a3c8fc1e00c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.842346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3b7838c67f4633907a3c8fc1e00c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.843158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3b7838c67f4633907a3c8fc1e00c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.843772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3b7838c67f4633907a3c8fc1e00c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:04.850869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3b7838c67f4633907a3c8fc1e00c05'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.028431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6b8325464947e0a9ead17758dfad8e', 'request_id': 'req-c68ca84a-9f9f-40d9-8f94-3474264c6b80'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.035434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6b8325464947e0a9ead17758dfad8e', 'request_id': 'req-c68ca84a-9f9f-40d9-8f94-3474264c6b80'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.047167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] The token cache is being invalidate because project ae6b8325464947e0a9ead17758dfad8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:05.047453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.048134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.049761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1035/2032] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:04 2022] DELETE /identity/v3/projects/ae6b8325464947e0a9ead17758dfad8e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:05.050507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:05.054143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:05.133079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ca84a-9f9f-40d9-8f94-3474264c6b80 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:05.138351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:05.139254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:05.139533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:05.139811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] PATH_INFO: `/v3/projects/693520ccf8c043e8b653e5794d819c08/users/138e1f0fdecc43b2a63ba56cde0d7e29/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:05.141954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693520ccf8c043e8b653e5794d819c08, user_id=138e1f0fdecc43b2a63ba56cde0d7e29, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:05.145175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40397e4d-1f59-41ef-8ae5-10b23b827c87 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:05.147723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 998/2033] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:04 2022] DELETE /identity/v3/users/de3b7838c67f4633907a3c8fc1e00c05 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:05.151749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:05.151749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:05.159352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1036/2034] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:05 2022] PUT /identity/v3/projects/693520ccf8c043e8b653e5794d819c08/users/138e1f0fdecc43b2a63ba56cde0d7e29/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:05.170135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:05.170858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:05.171609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:05.204708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] MFA Rules not processed for user `138e1f0fdecc43b2a63ba56cde0d7e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:05.206030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:05.232762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2042e1-5ef1-4a7f-9c55-f9d6d863db73 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:05.302443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:05.303093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:05.303373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:05.303647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] PATH_INFO: `/v3/users/c6597135fb5e40008432f3cff42a9c3d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:05.305042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6597135fb5e40008432f3cff42a9c3d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:05.307051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:05.323062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1037/2035] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:05.334877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:05.337082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:05.398339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5058b9-e154-430b-aa23-65a05f31c0d6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:05.405975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:05.406815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:05.407149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:05.407673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:05.417791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:05.419443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:05.434215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1038/2036] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:05.568096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6597135fb5e40008432f3cff42a9c3d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.582325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6597135fb5e40008432f3cff42a9c3d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.583263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6597135fb5e40008432f3cff42a9c3d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.585279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6597135fb5e40008432f3cff42a9c3d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.593344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6597135fb5e40008432f3cff42a9c3d'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:05.678615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:05.680062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:05.713756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 999/2037] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:05 2022] DELETE /identity/v3/users/c6597135fb5e40008432f3cff42a9c3d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:05.727204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efecec0-2916-46ee-a971-3e21da512c98 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:05.804925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:05.806537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:05.806884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:05.807231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] PATH_INFO: `/v3/projects/dd82faaee4d6458f867811a46cbd4a45` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:05.808758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd82faaee4d6458f867811a46cbd4a45)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:05.810814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:05.979394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd82faaee4d6458f867811a46cbd4a45', 'request_id': 'req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.090023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd82faaee4d6458f867811a46cbd4a45', 'request_id': 'req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.090188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:06.104500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd82faaee4d6458f867811a46cbd4a45', 'request_id': 'req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.117472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] The token cache is being invalidate because project dd82faaee4d6458f867811a46cbd4a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:06.118379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.119030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.120623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1039/2038] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:05 2022] DELETE /identity/v3/projects/dd82faaee4d6458f867811a46cbd4a45 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:06.124801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:06.126195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:06.140820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768dbd-83f2-4303-8456-200406ac493a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:06.192441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:06.196983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:06.219088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:06.220127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:06.220538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:06.220913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] PATH_INFO: `/v3/users/32a5c3306cd1476ab462c0d3ff1a7db5` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:06.224155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a5c3306cd1476ab462c0d3ff1a7db5)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:06.226452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:06.312332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0da5a9-4b60-47fe-b86a-be6322d54cc2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:06.317600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:06.318922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:06.326410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:06.327209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] PATH_INFO: `/v3/projects/cadf19477d2046379b56ffca48fe7514` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:06.328833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadf19477d2046379b56ffca48fe7514)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:06.330880 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:06.564697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a5c3306cd1476ab462c0d3ff1a7db5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.569513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadf19477d2046379b56ffca48fe7514', 'request_id': 'req-5b9ef063-feb0-4338-b023-a78636189767'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.583504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a5c3306cd1476ab462c0d3ff1a7db5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.584591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a5c3306cd1476ab462c0d3ff1a7db5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.585951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a5c3306cd1476ab462c0d3ff1a7db5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.613792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a5c3306cd1476ab462c0d3ff1a7db5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.711682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadf19477d2046379b56ffca48fe7514', 'request_id': 'req-5b9ef063-feb0-4338-b023-a78636189767'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.747913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadf19477d2046379b56ffca48fe7514', 'request_id': 'req-5b9ef063-feb0-4338-b023-a78636189767'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.747913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] The token cache is being invalidate because project cadf19477d2046379b56ffca48fe7514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:06.747913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.747913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5b9ef063-feb0-4338-b023-a78636189767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:06.747913 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1040/2039] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:06 2022] DELETE /identity/v3/projects/cadf19477d2046379b56ffca48fe7514 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:06.758022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00b6d-14fc-49d0-9073-f2ce0d9b4454 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:06.758340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00b6d-14fc-49d0-9073-f2ce0d9b4454 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:06.758608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be00b6d-14fc-49d0-9073-f2ce0d9b4454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:06.789170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2be00b6d-14fc-49d0-9073-f2ce0d9b4454 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:06.793850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2be00b6d-14fc-49d0-9073-f2ce0d9b4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1041/2040] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:07.033112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:07.033656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1042/2041] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:07.043252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:07.052758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e979af-9dce-4a8e-95f8-8f4f54b1ef25 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:07.057432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:07.058075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.058352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.058646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.059355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:07.059654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:07.061268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:07.073234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1043/2042] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:20:07.078150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:07.115923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1000/2043] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:06 2022] DELETE /identity/v3/users/32a5c3306cd1476ab462c0d3ff1a7db5 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:07.116592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3ce6-224d-4d96-8c99-863403cd037f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:07.241518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:07.241518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.241518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.241518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.242199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:07.242199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:07.314569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:07.316014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:07.330308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb13ed0-c983-410d-850a-ea2f08c40443 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:07.334900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:07.335985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.336299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.336609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] PATH_INFO: `/v3/users/3b24196474724b80800b3949c4f53e50` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.338113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b24196474724b80800b3949c4f53e50)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:07.340044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:07.571488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1044/2044] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:07 2022] POST /identity/v3/projects => generated 373 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:07.576034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:07.647802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889b75-1f1d-46f0-bffe-e1d581f98296 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:07.653037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:07.653923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.654209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.654483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.655224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:07.657366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:07.736412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:07.849542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1045/2045] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:07 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:07.849542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:07.849542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:07.850257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b24196474724b80800b3949c4f53e50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:07.850721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be48e-a04b-4ff5-bbc9-ec6cf3d9e4e1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:07.850721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:07.850721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:07.850721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:07.851081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] PATH_INFO: `/v3/users/14559374caf24ddaba9c2dd1d55defe7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:07.851081 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14559374caf24ddaba9c2dd1d55defe7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:07.851264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b24196474724b80800b3949c4f53e50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:07.851362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:07.851874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b24196474724b80800b3949c4f53e50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:07.853236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b24196474724b80800b3949c4f53e50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:07.860609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b24196474724b80800b3949c4f53e50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.056501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1001/2046] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:07 2022] DELETE /identity/v3/users/3b24196474724b80800b3949c4f53e50 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:08.060919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.060919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.132870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b91a-b549-4a6c-92a6-d2c6d7057107 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.137941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.138610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.138891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.139189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.139907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.141604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.153567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1002/2047] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:08.154203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.155845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.168852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6d1f-f5cb-4988-a2a9-accd2a5af7e2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.173694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.174590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.174873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.175172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] PATH_INFO: `/v3/projects/e1fb8937dede4aa793b98bf04235032d` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.176364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fb8937dede4aa793b98bf04235032d)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.178398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.242839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14559374caf24ddaba9c2dd1d55defe7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.270901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14559374caf24ddaba9c2dd1d55defe7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.280140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14559374caf24ddaba9c2dd1d55defe7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.281118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14559374caf24ddaba9c2dd1d55defe7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.281722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0e128034-bec9-42c3-b21f-13f21a57d32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14559374caf24ddaba9c2dd1d55defe7'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.330272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fb8937dede4aa793b98bf04235032d', 'request_id': 'req-7c06ac33-1634-4698-ad36-b63c21f27854'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.411150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1046/2048] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:07 2022] DELETE /identity/v3/users/14559374caf24ddaba9c2dd1d55defe7 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:08.412710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ee25-0751-483e-9421-0e74348a900d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.412996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ee25-0751-483e-9421-0e74348a900d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.413267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ee25-0751-483e-9421-0e74348a900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.455287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fb8937dede4aa793b98bf04235032d', 'request_id': 'req-7c06ac33-1634-4698-ad36-b63c21f27854'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.455539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9382ee25-0751-483e-9421-0e74348a900d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:08.456802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9382ee25-0751-483e-9421-0e74348a900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.464504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fb8937dede4aa793b98bf04235032d', 'request_id': 'req-7c06ac33-1634-4698-ad36-b63c21f27854'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.476597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] The token cache is being invalidate because project e1fb8937dede4aa793b98bf04235032d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:08.477864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.478601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:08.480415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1003/2049] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:08 2022] DELETE /identity/v3/projects/e1fb8937dede4aa793b98bf04235032d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:08.481562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.483099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.537923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1047/2050] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:08.540146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.540935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.541221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.563280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ac33-1634-4698-ad36-b63c21f27854 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.568082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:08.583933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.584179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.585694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.585694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.585694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.585694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.585694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581d56-65b2-4901-91bb-2f19ea3f5dd9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.586114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1048/2051] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:08.586114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.587849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.595455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1004/2052] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:08.599505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.599505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.599505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.617695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:08.619272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.628797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1005/2053] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:08.632945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.642795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73db4-e59b-4a34-b39a-a661462117ee None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.648358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.649829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.650113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.650684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] PATH_INFO: `/v3/projects/d0c9f60492704b6892d38cd4cffcfe37/users/65620e2ac2a344ddbb17052302e116ae/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.667921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d702d8-436a-4b8f-a6e2-c46a3613bbdc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.668135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c9f60492704b6892d38cd4cffcfe37, user_id=65620e2ac2a344ddbb17052302e116ae, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.670701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef1c1-b50a-4b21-96db-42cd2df3c833 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.672830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.674317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.674317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.674317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.687423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.691776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.704890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1049/2054] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:08.706087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.717997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f0c-53e4-4682-b2eb-cd2900279682 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.723607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.724474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.726893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.726893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.726893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:08.726893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.728509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.745546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1050/2055] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:08.746850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.770937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d157-685c-416b-b027-e1419baae34c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:08.796192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:08.796192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.796192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.796192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.796534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:08.796534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:08.839541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1006/2056] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:08 2022] PUT /identity/v3/projects/d0c9f60492704b6892d38cd4cffcfe37/users/65620e2ac2a344ddbb17052302e116ae/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:08.867585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:08.867585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:08.867585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:08.897826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] MFA Rules not processed for user `65620e2ac2a344ddbb17052302e116ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:08.900345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:08.964106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1051/2057] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:08 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:08.966069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:08.968108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.065873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1007/2058] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:09.067006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:09.126608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7523-c464-43f0-99a8-5733b86d1895 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.137844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.139909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.140979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.142859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] PATH_INFO: `/v3/projects/5e8854f2283343a8bef37d9dbecc987e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.145249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8854f2283343a8bef37d9dbecc987e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.149698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.155840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f931df-6d31-43bf-a1c5-58885c6c7cec None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.162850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.166177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.166177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.166177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.166177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.168021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.441782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1008/2059] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:09 2022] POST /identity/v3/users => generated 292 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:09.443507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:09.446493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.460255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8854f2283343a8bef37d9dbecc987e', 'request_id': 'req-ed60ed03-64fd-4f27-ae0f-49360b48198f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:09.510787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07049ab4-ea8d-48fb-ba0c-cd8362491608 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.561710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.562364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.562640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.562910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.609787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8854f2283343a8bef37d9dbecc987e', 'request_id': 'req-ed60ed03-64fd-4f27-ae0f-49360b48198f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:09.617228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8854f2283343a8bef37d9dbecc987e', 'request_id': 'req-ed60ed03-64fd-4f27-ae0f-49360b48198f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:09.625448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.627135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.629795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] The token cache is being invalidate because project 5e8854f2283343a8bef37d9dbecc987e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:09.630083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:09.630738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:09.632802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1052/2060] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:08 2022] DELETE /identity/v3/projects/5e8854f2283343a8bef37d9dbecc987e => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:09.634422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:09.638662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1009/2061] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:09.639561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:09.640898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.643379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.715569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ed03-64fd-4f27-ae0f-49360b48198f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.716919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f7326-9b01-4d02-9d79-a674685f279d service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.721618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.722640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.723073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.723442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.724429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.724578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.725578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.725860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.726156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] PATH_INFO: `/v3/projects/60fd44b5a21044a9b1b4abf80e6d5614` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.727832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fd44b5a21044a9b1b4abf80e6d5614)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.728251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00b59e-cdee-4bde-acef-b5185743a195 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.729944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.742555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1053/2062] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:09.744829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.745334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.745809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.774456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:09.775713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.785367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1054/2063] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:09.786156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:09.787346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:09.799199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fb02-9b83-4543-a8d6-48156dba6732 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:09.804013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:09.804888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:09.805783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:09.806057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] PATH_INFO: `/v3/users/65620e2ac2a344ddbb17052302e116ae` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:09.807282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65620e2ac2a344ddbb17052302e116ae)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:09.809224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:09.958744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:09.982904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fd44b5a21044a9b1b4abf80e6d5614', 'request_id': 'req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.078929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fd44b5a21044a9b1b4abf80e6d5614', 'request_id': 'req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.089602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fd44b5a21044a9b1b4abf80e6d5614', 'request_id': 'req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.105756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] The token cache is being invalidate because project 60fd44b5a21044a9b1b4abf80e6d5614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:10.106215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.106784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.108422 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1010/2064] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:09 2022] DELETE /identity/v3/projects/60fd44b5a21044a9b1b4abf80e6d5614 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:10.111349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.113236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.172859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65620e2ac2a344ddbb17052302e116ae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.193143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65620e2ac2a344ddbb17052302e116ae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.200970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65620e2ac2a344ddbb17052302e116ae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.201680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65620e2ac2a344ddbb17052302e116ae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.202396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65620e2ac2a344ddbb17052302e116ae'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.206981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfbcf1-6e7f-4eee-9639-a22ce5db5da5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.212402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.213994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.213994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.213994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.214390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.216008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370cf68-eca4-477f-bd44-2ba239c30441 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.226553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1011/2065] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:10.227826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.228116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.228417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.246884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:10.248100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.256277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1012/2066] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:10.257096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.258875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.270735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb17fb-0176-435a-8f64-4ded5a82e755 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.275902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.276876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.277159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.277434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] PATH_INFO: `/v3/users/138e1f0fdecc43b2a63ba56cde0d7e29` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.278629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138e1f0fdecc43b2a63ba56cde0d7e29)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.280686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.322529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1055/2067] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:09 2022] DELETE /identity/v3/users/65620e2ac2a344ddbb17052302e116ae => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:10.323366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.324724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.398793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d427b7-4800-470c-8782-8adaaf72d2f8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.405602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.406819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.407337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.407779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] PATH_INFO: `/v3/projects/29a92418445b4878a46c10134dbc3f1f/users/62ffcab591304c97a4f728b33359a403/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.428704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a92418445b4878a46c10134dbc3f1f, user_id=62ffcab591304c97a4f728b33359a403, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.439355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.538405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1056/2068] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:10 2022] PUT /identity/v3/projects/29a92418445b4878a46c10134dbc3f1f/users/62ffcab591304c97a4f728b33359a403/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:10.548365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138e1f0fdecc43b2a63ba56cde0d7e29'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.549543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.562695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138e1f0fdecc43b2a63ba56cde0d7e29'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.563605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138e1f0fdecc43b2a63ba56cde0d7e29'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.564378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138e1f0fdecc43b2a63ba56cde0d7e29'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.572868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ee370154-5937-44fc-b0de-b138b41717d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138e1f0fdecc43b2a63ba56cde0d7e29'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:10.616699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2e4d3-0b3a-4194-a059-999725d9d51c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.621795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.622490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.622772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.623046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.623770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:10.624077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.625750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf739fd-6821-4469-98bd-5a910f04da94 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.638322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1057/2069] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:10.639673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.639961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.640261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.660073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:10.660561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1013/2070] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:10 2022] DELETE /identity/v3/users/138e1f0fdecc43b2a63ba56cde0d7e29 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:10.661325 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.662923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.662923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.662923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.692151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] MFA Rules not processed for user `62ffcab591304c97a4f728b33359a403`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:10.697429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.744001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1058/2071] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:10.744001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.744001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.756375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095fc5e-3582-40d0-811f-0efcf4d3c3b5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.763623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.768322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.768322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.768322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.768322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.768322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.798695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1014/2072] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:10.798695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.798695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.809900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f978767-a760-4727-af2e-38187b7dd59c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.814665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.815545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.815809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.816081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] PATH_INFO: `/v3/users/3c0dba91293848b9923f4778837b8500` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:10.817310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0dba91293848b9923f4778837b8500)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:10.819225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:10.893444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1059/2073] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:10 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:10.894430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:10.899113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:10.969353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbbbb-c4e5-4325-b513-3c75ba245af4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:10.973990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:10.974843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:10.975125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:10.975400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.042374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.043796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.051988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:11.059704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1060/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:11.061749 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.061951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.073089 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0dba91293848b9923f4778837b8500'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.104659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0dba91293848b9923f4778837b8500'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.105980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0dba91293848b9923f4778837b8500'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.106609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0dba91293848b9923f4778837b8500'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.117055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0dba91293848b9923f4778837b8500'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.144887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb2c8-02e2-481f-add5-04d1632f000f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.148695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.149375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.149682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.149961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.151986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.217409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.217409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.223260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1015/2075] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:10 2022] DELETE /identity/v3/users/3c0dba91293848b9923f4778837b8500 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:11.224387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.225334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1061/2076] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:11.226199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.228293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.236686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.243993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5252a4-e8cb-49be-90fa-7d7f10c052bd service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.338012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.338367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.338467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.338704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] PATH_INFO: `/v3/projects/693520ccf8c043e8b653e5794d819c08` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.340863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693520ccf8c043e8b653e5794d819c08)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.342808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.370544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719227a-3457-4831-9b6e-9c27d603a152 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.375272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.375939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.376251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.377864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.378558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.380545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9d917-ce36-42dd-81a6-85003acce3d4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.507834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1016/2077] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:11 2022] POST /identity/v3/users => generated 296 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:11.509822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.516834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.516834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.521208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693520ccf8c043e8b653e5794d819c08', 'request_id': 'req-367099b7-3d0e-4434-bb77-4a52cf4638d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.536183 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:11.538093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.604231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1017/2078] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:11.605143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.614866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bdbd1-ccf8-4c65-a718-1d7fff48ec6d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.619490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.620136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.620446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.620719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.621437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.623024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.634523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1018/2079] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:11.634877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.637948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.693828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693520ccf8c043e8b653e5794d819c08', 'request_id': 'req-367099b7-3d0e-4434-bb77-4a52cf4638d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.694615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf937-1b0e-4bd1-8c66-d336158678e8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.698449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.703265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.703265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.703265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.703581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693520ccf8c043e8b653e5794d819c08', 'request_id': 'req-367099b7-3d0e-4434-bb77-4a52cf4638d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.714426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] The token cache is being invalidate because project 693520ccf8c043e8b653e5794d819c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:11.714857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.715646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:11.716126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.717887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1062/2080] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:11 2022] DELETE /identity/v3/projects/693520ccf8c043e8b653e5794d819c08 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:11.721542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8bc91-44e0-4ab5-97a9-0f186e441cc1 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.721660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.721660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.732029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1019/2081] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:11.733362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.733653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.733929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.738746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367099b7-3d0e-4434-bb77-4a52cf4638d6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.743801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.744510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.745327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.745327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.745794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.747416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.755770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:11.757075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.760490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1063/2082] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:11.764550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.766459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.778229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1020/2083] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:11.778229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:11.782340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac65d-d87f-48b5-bfdb-5ff3a4b540a5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.787635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.788673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.789070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.789441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] PATH_INFO: `/v3/projects/ebc93066c5a344f99d07e3e54ef115f7/users/86f0d82258784b198c8d088b52dec0d9/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.802416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d965-1cf1-43ae-b367-c4f91cef3f24 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:11.817066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:11.817344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc93066c5a344f99d07e3e54ef115f7, user_id=86f0d82258784b198c8d088b52dec0d9, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.817950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.818601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.818742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] PATH_INFO: `/v3/projects/d0c9f60492704b6892d38cd4cffcfe37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.821470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a95b-6d20-4d7f-a9b5-4609e2a3b54b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.822982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c9f60492704b6892d38cd4cffcfe37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:11.825273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:11.930994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1021/2084] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:11 2022] PUT /identity/v3/projects/ebc93066c5a344f99d07e3e54ef115f7/users/86f0d82258784b198c8d088b52dec0d9/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:11.932462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d334-511c-470a-9053-fc8422a835c7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:11.932756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d334-511c-470a-9053-fc8422a835c7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:11.933031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d334-511c-470a-9053-fc8422a835c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:11.950335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ce29d334-511c-470a-9053-fc8422a835c7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:11.951525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ce29d334-511c-470a-9053-fc8422a835c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:11.958837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:11.979915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c9f60492704b6892d38cd4cffcfe37', 'request_id': 'req-ec963a40-49bf-4afa-a46f-cda6be51da71'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.035651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1022/2085] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:12.037070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.045362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.045362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.058283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:12.059524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.123328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1023/2086] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:12.124424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.134481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f7dd-53a5-468b-95ca-5c6eb5371470 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.139313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.140404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.140404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.140673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.141985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:12.141985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.143282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.157569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1024/2087] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:12.159396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.160210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.204450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c9f60492704b6892d38cd4cffcfe37', 'request_id': 'req-ec963a40-49bf-4afa-a46f-cda6be51da71'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.213079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c9f60492704b6892d38cd4cffcfe37', 'request_id': 'req-ec963a40-49bf-4afa-a46f-cda6be51da71'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.224840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] The token cache is being invalidate because project d0c9f60492704b6892d38cd4cffcfe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:12.225128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.225784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.228000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1064/2088] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:11 2022] DELETE /identity/v3/projects/d0c9f60492704b6892d38cd4cffcfe37 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:12.229049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.232224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.245738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963a40-49bf-4afa-a46f-cda6be51da71 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.250570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.251246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.251535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.251817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.252545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.254537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c70e8-d5f1-4e2f-a1e3-51679991d2fd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.401887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b199-bcbf-4c6a-8fe9-376171f5f7b6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.406928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58267-186b-4450-a485-da38978d068b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.407929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58267-186b-4450-a485-da38978d068b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.408492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58267-186b-4450-a485-da38978d068b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.408933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58267-186b-4450-a485-da38978d068b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.411630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-56f58267-186b-4450-a485-da38978d068b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.424943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58267-186b-4450-a485-da38978d068b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.426527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58267-186b-4450-a485-da38978d068b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.435524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1065/2089] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:12.437134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.437647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.438699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1025/2090] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:12.439548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58267-186b-4450-a485-da38978d068b service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.440878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-56f58267-186b-4450-a485-da38978d068b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.450434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.462363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58267-186b-4450-a485-da38978d068b service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.490382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:12.491718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.520662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.521570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.521852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.522130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] PATH_INFO: `/v3/projects/107df6d14f39440eb301e4e073df569e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.523320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107df6d14f39440eb301e4e073df569e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.525917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.557085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1066/2091] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:12.557917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.569801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd94ea-4000-403b-9832-906db0de1a17 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.574490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.575142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.575422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.575689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.576426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.578581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21eaca-afdb-4123-a0d4-3eeee32b0466 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.708936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107df6d14f39440eb301e4e073df569e', 'request_id': 'req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.770439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1067/2092] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:12.771941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.772250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.772619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.793009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107df6d14f39440eb301e4e073df569e', 'request_id': 'req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.794466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:12.795690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.800900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107df6d14f39440eb301e4e073df569e', 'request_id': 'req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.812653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] The token cache is being invalidate because project 107df6d14f39440eb301e4e073df569e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:12.812845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.813440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:12.817926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1026/2093] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:12 2022] DELETE /identity/v3/projects/107df6d14f39440eb301e4e073df569e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:12.817926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.817926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.870580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1068/2094] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:12.870580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.871762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:12.885802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16514062-7fe9-4829-89dd-3c72631a7ace None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.891456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.892562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.893131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.893315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] PATH_INFO: `/v3/users/a43e44375be74efd8d3c996d9b3fb964` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.893556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb614877-b4a5-4344-aa8b-5bf22d5dfe41 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.894883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43e44375be74efd8d3c996d9b3fb964)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.897154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.900021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.901660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.901660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.901980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.902854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.904874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.916067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1027/2095] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:12.924378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.927096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328a16b-2dd1-48e4-83d6-3f273129111c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.932432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.933082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.933400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.933719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.934521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:12.934824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.936715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.949535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1028/2096] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:12.950252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.959851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d67a-4ba6-40b8-8125-693040bf8861 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.965045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.965666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.965948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.966205 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.966925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.968485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:12.977936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1029/2097] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:12.978666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:12.987829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988238-ba43-4ab1-9017-68d892e54afb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:12.992402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:12.993587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:12.993863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:12.994148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:12.994790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:12.996673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.112448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1030/2098] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:12 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:13.112448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.138295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:13.162488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43e44375be74efd8d3c996d9b3fb964'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:13.178739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43e44375be74efd8d3c996d9b3fb964'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:13.190685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43e44375be74efd8d3c996d9b3fb964'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:13.190685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43e44375be74efd8d3c996d9b3fb964'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:13.191007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dd02f-17b7-4374-bc3d-2e13a7c05c80 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.191117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43e44375be74efd8d3c996d9b3fb964'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:13.196808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.197735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.198019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.198294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] PATH_INFO: `/v3/projects/23abc7bfa19c4bc491a53a2ec76c73a1/users/cf02d583d52d4e1eace1759aa7f1dda4/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.213696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23abc7bfa19c4bc491a53a2ec76c73a1, user_id=cf02d583d52d4e1eace1759aa7f1dda4, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.216393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e660f3-2d24-46e3-b115-20d8708e3c57 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.428575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1069/2099] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:12 2022] DELETE /identity/v3/users/a43e44375be74efd8d3c996d9b3fb964 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:13.429171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.440615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1031/2100] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:13 2022] PUT /identity/v3/projects/23abc7bfa19c4bc491a53a2ec76c73a1/users/cf02d583d52d4e1eace1759aa7f1dda4/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:13.443412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.443768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.444417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.448342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:13.478150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] MFA Rules not processed for user `cf02d583d52d4e1eace1759aa7f1dda4`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:13.479274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:13.535304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2086-a1cd-4d08-9267-63e595be7c4f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.545507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.546219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.547602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.547888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.549202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.551600 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.562996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1032/2101] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:13.574292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.575729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:13.636799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916c301-a464-47b0-9ad2-b05d046b317a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.640403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.641045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.641323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.641594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.649956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.651376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.672594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1033/2102] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:13.693269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1070/2103] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:13 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:13.694503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.705997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0423-732c-490e-8900-abb59dbdf7f5 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.712050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.712750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.713034 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.713308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.714206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.716646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.743769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1034/2104] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:13.745364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.757660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f33824-cba9-4ee4-8859-0952de93e738 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.763225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.764047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.765659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.765659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.765659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.767117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29a17e-d90a-4dc0-8de4-1b7fb316176b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.779460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1071/2105] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:13.783433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.794329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8fdd8-f181-4bb2-a572-b2162e52cadb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.799850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.800271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.801274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.801274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] PATH_INFO: `/v3/projects/37034503391847d382b36064c61314b1/users/2b7ec4dd376240d58ca28763f1caa386/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.825524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37034503391847d382b36064c61314b1, user_id=2b7ec4dd376240d58ca28763f1caa386, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.828912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.963680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1035/2106] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:13 2022] PUT /identity/v3/projects/37034503391847d382b36064c61314b1/users/2b7ec4dd376240d58ca28763f1caa386/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:13.974157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.974447 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.974721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.014017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] MFA Rules not processed for user `2b7ec4dd376240d58ca28763f1caa386`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:14.014017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:14.090959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1072/2107] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:14.095705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.126352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.128181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:14.172170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0f96-3653-40f3-83a1-60346c67a359 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.177033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.177697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.177975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.178248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.178961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.180943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.209363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e17db-b021-4195-b22f-36fdf66e968a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.214451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.215300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.215574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.215840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] PATH_INFO: `/v3/projects/7799482fdfa84f258b47682c681dca38` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.217054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7799482fdfa84f258b47682c681dca38)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.218950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.400795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1036/2108] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/projects => generated 373 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:14.402051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.409887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7799482fdfa84f258b47682c681dca38', 'request_id': 'req-98efd864-3590-4f58-b24d-c55eafdfb144'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:14.484388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328a4a-324a-4bb1-a9eb-dbd3a3cda862 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.491688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.493133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.499207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.499207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.499207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.499207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.600187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:14.600924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7799482fdfa84f258b47682c681dca38', 'request_id': 'req-98efd864-3590-4f58-b24d-c55eafdfb144'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:14.608689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7799482fdfa84f258b47682c681dca38', 'request_id': 'req-98efd864-3590-4f58-b24d-c55eafdfb144'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:14.621752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] The token cache is being invalidate because project 7799482fdfa84f258b47682c681dca38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:14.622041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:14.623198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-98efd864-3590-4f58-b24d-c55eafdfb144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:14.624850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1073/2109] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:14 2022] DELETE /identity/v3/projects/7799482fdfa84f258b47682c681dca38 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:14.637378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba36-2f07-40f9-a223-27ed8a8e827c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.637378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba36-2f07-40f9-a223-27ed8a8e827c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.637378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba36-2f07-40f9-a223-27ed8a8e827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.654523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c958ba36-2f07-40f9-a223-27ed8a8e827c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:14.656559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c958ba36-2f07-40f9-a223-27ed8a8e827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:14.680313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1037/2110] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:14.688321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1074/2111] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:14.691344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.691481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.691884 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.692217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.693371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:14.705551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3f3-f531-43e1-8c7d-916dc9f8961e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.710343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.711887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.711887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.712335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:14.713845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.713965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:14.717137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.718762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.726060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1075/2112] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:14.727845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.730476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1038/2113] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:14.734550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.739246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c47ca-0c65-499b-8b8f-12ef3f1751a4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.743866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.744163 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758ce3a-ec0e-4d0f-84d7-fe0dfc5e5a7a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.744543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.744856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.745153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.745870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:14.746175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.747951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.750274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.751270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.751629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.752553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] PATH_INFO: `/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4/users/934b013e3d1a405991bd8a09d4d68e0f/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.764242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1076/2114] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:14.768083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.770679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] RBAC: Authorizing `identity:create_grant(project_id=107b08511b9d4dd3a2c302bdbab8b1a4, user_id=934b013e3d1a405991bd8a09d4d68e0f, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.774883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.780732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be005be-ebd5-4187-bce7-4082f0e55ea9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:14.795953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:14.797118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:14.803115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:14.803459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:14.804189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:14.806541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:14.859098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1039/2115] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:14 2022] PUT /identity/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4/users/934b013e3d1a405991bd8a09d4d68e0f/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:14.865752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.952461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1077/2116] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:14.957282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:14.975888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a6b-9295-4d90-9a10-e6208715156b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.039873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044efa5-17c4-411f-a3da-503fd204db98 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.045126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.046889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.046889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.047100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.047204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.047377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.047466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.047549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.047549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.047699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.048833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.049227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.062747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1040/2117] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:15.063705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.074421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c480b-46d7-4fad-9c9b-fc5fc95e96ee admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.079943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.080617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.081070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.081345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] PATH_INFO: `/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4/users/934b013e3d1a405991bd8a09d4d68e0f/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.083275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107b08511b9d4dd3a2c302bdbab8b1a4, user_id=934b013e3d1a405991bd8a09d4d68e0f, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.085933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b75d8-1f4a-465a-940c-34412a9cc410 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.106851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1041/2118] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:15 2022] PUT /identity/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4/users/934b013e3d1a405991bd8a09d4d68e0f/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:15.108420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.108704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.109136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.138569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] MFA Rules not processed for user `934b013e3d1a405991bd8a09d4d68e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:15.140401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:15.221495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1042/2119] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:15.229338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.230778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:15.248917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1078/2120] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:14 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:15.264528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.287803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9a33-6fca-4ff2-abc7-0c4227cad43a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.356757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366a538-b90a-4f95-9b13-729f2ef8607c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.362350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.363020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.363301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.363574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.366352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:15.412335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.413037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.413489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.413941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.416414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.418959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.436493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1079/2121] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:15.441728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.465541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d589f-25b8-41f6-8872-32370e405b1e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.468836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.475654 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.477690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.479829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.480178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.480536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.481518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.485097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b34b3f-9d52-41a1-a565-058b0269faea admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.496276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1043/2122] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:15.504348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1080/2123] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:15.507072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.531182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41fad4-81b7-4f16-af94-da718742b771 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.538533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.542526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.542873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.544961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] PATH_INFO: `/v3/projects/08fdea5bdf9546afaa1cd6403acdf9f7/users/cd62471ef44c4bf2b74f974e517f3a97/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.566760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fdea5bdf9546afaa1cd6403acdf9f7, user_id=cd62471ef44c4bf2b74f974e517f3a97, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.570274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:15.709454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1044/2124] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:15 2022] PUT /identity/v3/projects/08fdea5bdf9546afaa1cd6403acdf9f7/users/cd62471ef44c4bf2b74f974e517f3a97/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:15.721172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.721588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.721872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.736161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:15.755655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] MFA Rules not processed for user `cd62471ef44c4bf2b74f974e517f3a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:15.756999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:15.824448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1081/2125] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:15.829115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:15.896552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b324a2-34ae-430e-af83-7f3f9954968f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:15.901731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:15.902397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:15.902681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:15.903437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:15.903969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:15.905912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.058299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1045/2126] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:16.062417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.081479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3879e1-fec1-4f3f-af25-510025548af0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.162791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.163480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.163764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.164039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.164968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.166894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.305121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1082/2127] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:16 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:16.309974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.335046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beaac5-610a-4146-9bb1-63377bb24387 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.342538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.343218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.343505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.343781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.344560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.346403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.361169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1046/2128] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:16.365446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.374024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98e91-6459-4bbc-ba8c-ba23d38373cc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.378828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.379724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.380008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.380312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] PATH_INFO: `/v3/projects/6ba4104659d74debb0d95859ca639fdb/users/ee68e4dc4cdf448086f36bf28d457e85/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.415725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba4104659d74debb0d95859ca639fdb, user_id=ee68e4dc4cdf448086f36bf28d457e85, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.419039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.528034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1083/2129] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:16 2022] PUT /identity/v3/projects/6ba4104659d74debb0d95859ca639fdb/users/ee68e4dc4cdf448086f36bf28d457e85/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:16.529585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.550438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab6b91-af88-40fa-97a0-4e7420a108d4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.659733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.664065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.666763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.667092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.668499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.669575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbad2a-709a-4baf-bc2a-efebe615d342 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.685150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1047/2130] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:16.686283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.705008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19394-680d-40e2-a123-bcba2b6bf3f3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.709388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.710936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.711495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.712058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] PATH_INFO: `/v3/projects/6ba4104659d74debb0d95859ca639fdb/users/ee68e4dc4cdf448086f36bf28d457e85/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.714702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba4104659d74debb0d95859ca639fdb, user_id=ee68e4dc4cdf448086f36bf28d457e85, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.717916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.732618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1084/2131] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:16 2022] PUT /identity/v3/projects/6ba4104659d74debb0d95859ca639fdb/users/ee68e4dc4cdf448086f36bf28d457e85/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:16.741565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27baef-5e38-4af8-a066-b55d180117fc None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.741850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27baef-5e38-4af8-a066-b55d180117fc None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.742185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27baef-5e38-4af8-a066-b55d180117fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.800643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6e27baef-5e38-4af8-a066-b55d180117fc None None] MFA Rules not processed for user `ee68e4dc4cdf448086f36bf28d457e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:16.802056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6e27baef-5e38-4af8-a066-b55d180117fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:16.887117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1048/2132] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:16.898203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.901204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:16.964379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a38a1-f477-47bc-ab3b-bd420bb0a2b0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.968182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.968861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.969140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.969413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.979492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.981068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274376a-3e64-4cda-b949-d68d62fff848 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.991448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1085/2133] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:18.491339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:19.712741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:19.716679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:19.716679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:19.745864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] MFA Rules not processed for user `86f0d82258784b198c8d088b52dec0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:19.747133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:19.816675 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1049/2134] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:19.828571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:19.829020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:19.829020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:19.847533 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] MFA Rules not processed for user `86f0d82258784b198c8d088b52dec0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:19.853356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:19.862184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1086/2135] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:19.875306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:19.877061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:19.918303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:19.970206 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b774a-f3a9-4a04-b669-625da424965a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:19.981857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:19.981857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:19.981857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:19.981857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:19.994382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:19.996045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6d362-9822-4cc0-a253-1b57e8b1c41d service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:20.004750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:20.009509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1050/2136] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:20.097908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551268d-ffe3-451b-8576-ed08212fd778 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:20.105113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:20.106684 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:20.107529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:20.108512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] PATH_INFO: `/v3/users/2b7ec4dd376240d58ca28763f1caa386` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:20.110305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7ec4dd376240d58ca28763f1caa386)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:20.112700 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:20.457588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7ec4dd376240d58ca28763f1caa386'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:20.501033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7ec4dd376240d58ca28763f1caa386'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:20.509191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7ec4dd376240d58ca28763f1caa386'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:20.510022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7ec4dd376240d58ca28763f1caa386'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:20.510638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7ec4dd376240d58ca28763f1caa386'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:20.746629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1087/2137] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:20 2022] DELETE /identity/v3/users/2b7ec4dd376240d58ca28763f1caa386 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:20.749557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790b36-f1ae-479e-896d-546f83db183c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:20.750312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790b36-f1ae-479e-896d-546f83db183c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:20.750312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64790b36-f1ae-479e-896d-546f83db183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:20.770510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:20.772012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:20.800188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-64790b36-f1ae-479e-896d-546f83db183c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:20.814448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-64790b36-f1ae-479e-896d-546f83db183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:20.973587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf63f57-e8ee-47c3-b190-4ec825103ee4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:20.981553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:20.983287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:20.983937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:20.984421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] PATH_INFO: `/v3/users/cd62471ef44c4bf2b74f974e517f3a97` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:20.991873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd62471ef44c4bf2b74f974e517f3a97)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:20.991873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:21.007606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1051/2138] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:21.009705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:21.012851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:21.013436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:21.035892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] MFA Rules not processed for user `86f0d82258784b198c8d088b52dec0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:21.037126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:21.103914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1052/2139] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:21.104518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:21.108672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:21.181700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25781c-637a-4326-b221-fff3066a7f82 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:21.186435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:21.187276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:21.187566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:21.187843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:21.199022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:21.200576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea368d-d6d5-4544-a3dc-098a38db616b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:21.212785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1053/2140] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:21.381506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd62471ef44c4bf2b74f974e517f3a97'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:21.414917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd62471ef44c4bf2b74f974e517f3a97'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:21.431104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd62471ef44c4bf2b74f974e517f3a97'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:21.433490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd62471ef44c4bf2b74f974e517f3a97'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:21.435621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd62471ef44c4bf2b74f974e517f3a97'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:21.554504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1088/2141] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:20 2022] DELETE /identity/v3/users/cd62471ef44c4bf2b74f974e517f3a97 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:21.557501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:21.557953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:21.558240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:21.582420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:21.584085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:21.673827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1054/2142] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:21.686774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:21.689083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:21.707697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:21.773292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6a7d-8cb0-45da-8072-b6b57ae364e8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:21.777064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:21.777787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:21.784719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:21.784719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:21.788795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:21.790978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:21.801366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1089/2143] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:21.826200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:21.827717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:21.840042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe682-5b2c-49c4-8ad3-94f0c945d584 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:21.845375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:21.846480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:21.846947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:21.847434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] PATH_INFO: `/v3/projects/37034503391847d382b36064c61314b1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:21.848845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37034503391847d382b36064c61314b1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:21.851083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:22.036637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37034503391847d382b36064c61314b1', 'request_id': 'req-3b7352e7-0fd8-4898-a835-90726d710a1e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.175835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37034503391847d382b36064c61314b1', 'request_id': 'req-3b7352e7-0fd8-4898-a835-90726d710a1e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.184316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37034503391847d382b36064c61314b1', 'request_id': 'req-3b7352e7-0fd8-4898-a835-90726d710a1e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.216580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] The token cache is being invalidate because project 37034503391847d382b36064c61314b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:22.216879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.221770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.241586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1055/2144] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:21 2022] DELETE /identity/v3/projects/37034503391847d382b36064c61314b1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:22.246629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:22.260735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c606d-e5ac-4490-a89f-51e7c7bfe9b0 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:22.337865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:22.338744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:22.339025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:22.339299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] PATH_INFO: `/v3/users/934b013e3d1a405991bd8a09d4d68e0f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:22.340546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934b013e3d1a405991bd8a09d4d68e0f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:22.342524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:22.407943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:22.409563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:22.429116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7352e7-0fd8-4898-a835-90726d710a1e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:22.457838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:22.459070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:22.459455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:22.460699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] PATH_INFO: `/v3/users/62ffcab591304c97a4f728b33359a403` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:22.467376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ffcab591304c97a4f728b33359a403)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:22.469580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:22.626647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934b013e3d1a405991bd8a09d4d68e0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.648107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934b013e3d1a405991bd8a09d4d68e0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.657578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934b013e3d1a405991bd8a09d4d68e0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.658613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934b013e3d1a405991bd8a09d4d68e0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.662536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934b013e3d1a405991bd8a09d4d68e0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.831527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1090/2145] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:22 2022] DELETE /identity/v3/users/934b013e3d1a405991bd8a09d4d68e0f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:22.831527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:22.844147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:22.846607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ffcab591304c97a4f728b33359a403'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.869174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ffcab591304c97a4f728b33359a403'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.872630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ffcab591304c97a4f728b33359a403'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.873766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ffcab591304c97a4f728b33359a403'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.886303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5e5af5e-d83d-4330-b567-29581ad22dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ffcab591304c97a4f728b33359a403'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:22.955646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939827-5ed3-4438-a238-0e7693bcfc93 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:22.963485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:22.964393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:22.964694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:22.964974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] PATH_INFO: `/v3/projects/08fdea5bdf9546afaa1cd6403acdf9f7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:22.967429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fdea5bdf9546afaa1cd6403acdf9f7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:22.969844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:22.994088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1056/2146] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:22 2022] DELETE /identity/v3/users/62ffcab591304c97a4f728b33359a403 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:23.010494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:23.010783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:23.011059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:23.036096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:23.038890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:23.150929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fdea5bdf9546afaa1cd6403acdf9f7', 'request_id': 'req-0a907e2c-6df2-4e0d-9132-78de3630ee89'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.204319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1057/2147] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:23.214868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:23.214868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:23.295115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcafef-0af2-4b64-aff7-b8c7d6d0d4f8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:23.387368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:23.388644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:23.397982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:23.397982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:23.467453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fdea5bdf9546afaa1cd6403acdf9f7', 'request_id': 'req-0a907e2c-6df2-4e0d-9132-78de3630ee89'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.476479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fdea5bdf9546afaa1cd6403acdf9f7', 'request_id': 'req-0a907e2c-6df2-4e0d-9132-78de3630ee89'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.477751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:23.480616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:23.488552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] The token cache is being invalidate because project 08fdea5bdf9546afaa1cd6403acdf9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:23.488897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.489584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.491877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1091/2148] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:22 2022] DELETE /identity/v3/projects/08fdea5bdf9546afaa1cd6403acdf9f7 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:23.510872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:23.514690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:23.537141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1058/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:23.539349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:23.543670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:23.550122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907e2c-6df2-4e0d-9132-78de3630ee89 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:23.556631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:23.557717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:23.558094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:23.558467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] PATH_INFO: `/v3/users/ee68e4dc4cdf448086f36bf28d457e85` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:23.559874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee68e4dc4cdf448086f36bf28d457e85)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:23.562021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:23.584994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a0b0-d1c0-4173-922f-4aa217531135 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:23.596660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:23.597830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:23.598288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:23.598735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] PATH_INFO: `/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:23.600478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=107b08511b9d4dd3a2c302bdbab8b1a4)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:23.603168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:23.892551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107b08511b9d4dd3a2c302bdbab8b1a4', 'request_id': 'req-bfea4aeb-0733-431b-a934-cdbd2a85630b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.901367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee68e4dc4cdf448086f36bf28d457e85'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.924416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee68e4dc4cdf448086f36bf28d457e85'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.932477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee68e4dc4cdf448086f36bf28d457e85'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.933220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee68e4dc4cdf448086f36bf28d457e85'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.933869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee68e4dc4cdf448086f36bf28d457e85'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.992975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107b08511b9d4dd3a2c302bdbab8b1a4', 'request_id': 'req-bfea4aeb-0733-431b-a934-cdbd2a85630b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.000410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107b08511b9d4dd3a2c302bdbab8b1a4', 'request_id': 'req-bfea4aeb-0733-431b-a934-cdbd2a85630b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.017571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] The token cache is being invalidate because project 107b08511b9d4dd3a2c302bdbab8b1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:24.017858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.018998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bfea4aeb-0733-431b-a934-cdbd2a85630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.021219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1059/2150] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:23 2022] DELETE /identity/v3/projects/107b08511b9d4dd3a2c302bdbab8b1a4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:24.026190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71005-9103-4ad6-984b-03cf9ce25051 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.026473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71005-9103-4ad6-984b-03cf9ce25051 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.026781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71005-9103-4ad6-984b-03cf9ce25051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.058288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-84d71005-9103-4ad6-984b-03cf9ce25051 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.059523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-84d71005-9103-4ad6-984b-03cf9ce25051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.152796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1060/2151] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.160910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.161199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.161530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.181749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.182992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.184752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1092/2152] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:23 2022] DELETE /identity/v3/users/ee68e4dc4cdf448086f36bf28d457e85 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:24.260132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1061/2153] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:24.264931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.267522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.293130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208a1f9-6c06-4aa8-ac91-9d1d2c31fcab admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.309227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.310334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.310774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.311773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.312556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:24.312872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.315176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.326475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.331896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.358722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1093/2154] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:24.359727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.364350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4f06e-0b7f-4111-90f3-738bbe2a5771 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.376625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.377627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.379232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.379232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] PATH_INFO: `/v3/projects/29a92418445b4878a46c10134dbc3f1f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.382049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a92418445b4878a46c10134dbc3f1f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.386196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.386348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309015dd-1f83-45c7-b212-d6ae7572b964 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.399625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.405013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.405696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.406230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.407996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.409662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.604097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1094/2155] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:24.608721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.615548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a92418445b4878a46c10134dbc3f1f', 'request_id': 'req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.701857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e0fe-c442-4dfe-a173-4767d26930ee admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.728414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.729069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.729428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.729621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.730359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.749894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.759420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a92418445b4878a46c10134dbc3f1f', 'request_id': 'req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.767377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a92418445b4878a46c10134dbc3f1f', 'request_id': 'req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.791032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] The token cache is being invalidate because project 29a92418445b4878a46c10134dbc3f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:24.791032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.793232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e9d4cc4c-a3a9-423f-9676-9e628736d6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.797039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1062/2156] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:24 2022] DELETE /identity/v3/projects/29a92418445b4878a46c10134dbc3f1f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:24.801652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd02e59-f5ac-4404-b699-90208c0abd86 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.806507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd02e59-f5ac-4404-b699-90208c0abd86 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.806507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd02e59-f5ac-4404-b699-90208c0abd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.842344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6cd02e59-f5ac-4404-b699-90208c0abd86 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.843587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6cd02e59-f5ac-4404-b699-90208c0abd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.862508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1063/2157] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.871677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.872011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.872363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.884315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1095/2158] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:24.887619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.893663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.905849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.907058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.907928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60d801-1f59-45ad-abbb-81502b49867a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.913069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.913914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.919027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.919027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.919235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1064/2159] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.919787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.920187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.921853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.931055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc57c1-391e-4507-beef-6bb772b56b60 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.935781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1096/2160] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:24.937616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.938411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.940638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.944644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.944951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.946236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:24.946545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.948470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.957349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09343f12-56c8-4b66-9e67-85a794759502 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.962602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.963364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.963732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.964076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.965073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.967041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.967574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1065/2161] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:20:24.968779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.980173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd390c-2981-4c7a-9a15-5e5666b823aa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.984765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1097/2162] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:24.987222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.989185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.989185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.989185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.009137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.009255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.009255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.016931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c97e0-f995-433c-a95e-1566551a17b0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.024150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.024716 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.024990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.025257 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] PATH_INFO: `/v3/projects/8f40426c82a64732b83846425c5b5be9/users/2ed266f163ec4affa70580d2602d0720/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.043857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f40426c82a64732b83846425c5b5be9, user_id=2ed266f163ec4affa70580d2602d0720, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.046552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.079035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:25.127228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1066/2163] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:25.134219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.137021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.223583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1098/2164] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:24 2022] PUT /identity/v3/projects/8f40426c82a64732b83846425c5b5be9/users/2ed266f163ec4affa70580d2602d0720/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:25.224800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.228454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2816ce5-1011-46b3-9d17-dfcb39fcf346 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.292036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.292929 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.293207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.293477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] PATH_INFO: `/v3/projects/6ba4104659d74debb0d95859ca639fdb` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.294670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba4104659d74debb0d95859ca639fdb)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.296637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.300436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024308a-dc9b-4c1e-b060-4f373700b907 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.309182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.309865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.310146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.310416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.311212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.313185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed7d56-238f-4c4f-b0a2-4307596e6fbe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.489477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1099/2165] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:25.495181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.495973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.497198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.517448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba4104659d74debb0d95859ca639fdb', 'request_id': 'req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:25.534423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:25.536997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.603166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1100/2166] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:25.604886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.620397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28556d9-8156-493f-be52-b1e0ab167263 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.624940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.625632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.625910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.626182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.626898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.628542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.638454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1101/2167] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:25.639235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.640870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.661607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba4104659d74debb0d95859ca639fdb', 'request_id': 'req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:25.672060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba4104659d74debb0d95859ca639fdb', 'request_id': 'req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:25.683628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] The token cache is being invalidate because project 6ba4104659d74debb0d95859ca639fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:25.683984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:25.684745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:25.686332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1067/2168] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:25 2022] DELETE /identity/v3/projects/6ba4104659d74debb0d95859ca639fdb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:25.687117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.688513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.701780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6da9-b2f5-48af-b183-0e4ed6f3e6b4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.705388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb92ad-6dc9-4dc4-a51d-9f377e7db0c9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.706814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.707480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.707760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.708229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.709113 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.709670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.710302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.710692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d8195-1caf-4d92-8af3-16c1a4f54b00 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.710812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.711075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.713345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.720913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1068/2169] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:25.722080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f41e1-10b1-479f-b777-238710a866b8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.722365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f41e1-10b1-479f-b777-238710a866b8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.723443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f41e1-10b1-479f-b777-238710a866b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.731115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.731901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.741673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-863f41e1-10b1-479f-b777-238710a866b8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:25.742168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1102/2170] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:25.743676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-863f41e1-10b1-479f-b777-238710a866b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.744063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.757783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1069/2171] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:25.757969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6491e3-6db5-4fe3-974f-eede618829c5 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.758472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.759322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.759436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.759608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.759735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.759876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] PATH_INFO: `/v3/projects/1b4b09f3747e44369533a5f477a11a49/users/c2cdcc14c65749f8ad08272a9ecf270d/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.759972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.776762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4b09f3747e44369533a5f477a11a49, user_id=c2cdcc14c65749f8ad08272a9ecf270d, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.779397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321894-8df7-4ce4-968e-c2efb6880888 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.779595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:25.780812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:25.791046 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1070/2172] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:25.795962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.805906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e10e08-1959-4d0a-b80c-440149fe221f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.811894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.812644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.812924 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.813200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.813974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:25.814278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.815884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.843699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1071/2173] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:25.844963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.862092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819f0c-5e74-4f2c-9023-3f2c6aa590cf admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.868335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.869014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.869296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.869567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.870272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.873148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.887177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1103/2174] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:25 2022] PUT /identity/v3/projects/1b4b09f3747e44369533a5f477a11a49/users/c2cdcc14c65749f8ad08272a9ecf270d/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:25.902020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.902380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.902729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.941583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] MFA Rules not processed for user `c2cdcc14c65749f8ad08272a9ecf270d`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:25.943044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:26.004572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1072/2175] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:26.005594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.078564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1104/2176] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:26.094940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.097922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:26.149415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdd2-ec81-44c6-bcc0-c8d5bf817d5c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.154754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.155540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.156081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.156192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.157045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.160419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.176387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c13e-9e0f-450e-b272-0c3c049ffcd7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.250477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.251534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.251843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.252118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.292123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1073/2177] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:26 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:26.296067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.306756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c63e-2af3-479c-b09b-cfbd78d740cc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.311569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.312289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.312577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.312852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.313575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.315195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.330952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1074/2178] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:26.337178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.349128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08bef-a6ee-47fd-ba72-65c2c35e9cc9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.352407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.354080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.354274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.354886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.355166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.355466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.356396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.361790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eaec9-38f9-4ab8-9a27-cc6267144771 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.368957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1105/2179] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:26.372246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1075/2180] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:26.375360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.389798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634590f3-1e1a-41f1-aed9-f8fafe3c5032 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.395933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.397795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.410171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.410171 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] PATH_INFO: `/v3/projects/1e7d8551c6bc4113976e71ea8b86b429/users/a90e540188034e138f9af9e6159c89bf/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.415661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7d8551c6bc4113976e71ea8b86b429, user_id=a90e540188034e138f9af9e6159c89bf, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.419031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.564569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1106/2181] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:26 2022] PUT /identity/v3/projects/1e7d8551c6bc4113976e71ea8b86b429/users/a90e540188034e138f9af9e6159c89bf/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:26.573712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.573712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.573712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.575029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.577282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:26.614191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] MFA Rules not processed for user `a90e540188034e138f9af9e6159c89bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:26.615834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:26.672321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69476cc4-67dd-4be7-8a8b-97d9aa8e32a8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.680958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.682746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.683099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.683395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] PATH_INFO: `/v3/users/c1b50b66fdf340da8ddb1da4fe4fbce1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.684869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b50b66fdf340da8ddb1da4fe4fbce1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.688740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.703701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1076/2182] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:26.709563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.722233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422471-cf49-4602-b3a2-75f987c26546 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.727565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.728609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.728890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.729173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.729901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.731843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.851233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1077/2183] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:26 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:26.855177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:26.896393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b50b66fdf340da8ddb1da4fe4fbce1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:26.910937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b50b66fdf340da8ddb1da4fe4fbce1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:26.918895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b50b66fdf340da8ddb1da4fe4fbce1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:26.919606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b50b66fdf340da8ddb1da4fe4fbce1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:26.920246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0f4730c3-2898-4091-9ced-4e62e178c212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b50b66fdf340da8ddb1da4fe4fbce1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:26.925243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6513-e270-473d-8029-cb87ce254105 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:26.931268 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:26.932363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:26.932666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:26.932936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:26.933659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:26.935672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:26.997715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:27.037648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1107/2184] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:26 2022] DELETE /identity/v3/users/c1b50b66fdf340da8ddb1da4fe4fbce1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:27.037648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.037840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.038104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.041925 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1078/2185] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:26 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:27.047272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:27.055610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:27.070690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:27.072470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:27.114389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae2ee-d8f2-4cdd-96ce-87ed43287d22 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:27.202846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1108/2186] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:27.220281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:27.224681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:27.297367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:27.298242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.298946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.299373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.301208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:27.307375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:27.336527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1079/2187] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:27.342364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:27.361618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab02e7a-5a50-466a-a6a8-256ae0fb8aad admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:27.374124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:27.374124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.374124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.374124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] PATH_INFO: `/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1/users/76cfb8c115bd48a48cedfaf337cf413a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.382234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b674c8-2de5-4be2-aed1-d99dbe9651d4 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:27.390036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:27.408971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.413765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.413765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.417201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a85ce92b64473895e2ad4c3ceed4a1, user_id=76cfb8c115bd48a48cedfaf337cf413a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:27.419891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:27.453221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:27.453221 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:27.471661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1109/2188] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:27.555753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1080/2189] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:27 2022] PUT /identity/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1/users/76cfb8c115bd48a48cedfaf337cf413a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:27.559977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:27.570194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc539a2-9d43-4381-b4bc-8353ae9978af service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:27.632471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:27.633782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.634158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.634866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.635179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:27.636859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a89db-3ac3-40e3-937a-429a46761164 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:27.653858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1110/2190] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:27.665932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:27.676943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce37c1-4b26-4746-b860-a481d461dedd admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:27.681789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:27.682758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.683040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.683338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] PATH_INFO: `/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1/users/76cfb8c115bd48a48cedfaf337cf413a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.685452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a85ce92b64473895e2ad4c3ceed4a1, user_id=76cfb8c115bd48a48cedfaf337cf413a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:27.688149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:27.702395 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1081/2191] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:27 2022] PUT /identity/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1/users/76cfb8c115bd48a48cedfaf337cf413a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:27.717341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fba21-412a-41d3-8b57-1b86d915171c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:27.718813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fba21-412a-41d3-8b57-1b86d915171c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:27.719374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fba21-412a-41d3-8b57-1b86d915171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:27.784961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ad7fba21-412a-41d3-8b57-1b86d915171c None None] MFA Rules not processed for user `76cfb8c115bd48a48cedfaf337cf413a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:27.786254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ad7fba21-412a-41d3-8b57-1b86d915171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:27.926676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1111/2192] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:28.306582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:28.308418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:28.416667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e331-c834-4e64-b306-b7004573499d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:28.416938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e331-c834-4e64-b306-b7004573499d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:28.417226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e331-c834-4e64-b306-b7004573499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:28.419199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea858-b18f-4283-aa52-56a30454cf46 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:28.433360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:28.434218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:28.434707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:28.435543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:28.441074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:28.469233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9f09e331-c834-4e64-b306-b7004573499d None None] MFA Rules not processed for user `2ed266f163ec4affa70580d2602d0720`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:28.470496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9f09e331-c834-4e64-b306-b7004573499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:28.554590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:28.556725 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:28.576662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1082/2193] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:28.603409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1112/2194] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:28.843879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:28.854218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb93cb3-1c9b-4bb8-bc8b-a4924ad07726 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:28.865829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:28.866761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:28.867785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:28.867991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:28.877359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:28.878836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54444-e89b-49a5-880e-0902052c4409 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:28.889159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1083/2195] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:29.062725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e331-c834-4e64-b306-b7004573499d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:29.064219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9f09e331-c834-4e64-b306-b7004573499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:29.147827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e331-c834-4e64-b306-b7004573499d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:29.156950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:29.158139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:29.170026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:29.170026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] PATH_INFO: `/v3/projects/9306f786142149c5bc871b2007e0f6ef` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:29.170026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9306f786142149c5bc871b2007e0f6ef)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:29.170026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:29.198556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:29.310209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9306f786142149c5bc871b2007e0f6ef', 'request_id': 'req-a77a3a34-78bd-4031-9a18-4b8295453ae8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:29.400958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9306f786142149c5bc871b2007e0f6ef', 'request_id': 'req-a77a3a34-78bd-4031-9a18-4b8295453ae8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:29.424237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9306f786142149c5bc871b2007e0f6ef', 'request_id': 'req-a77a3a34-78bd-4031-9a18-4b8295453ae8'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:29.467872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] The token cache is being invalidate because project 9306f786142149c5bc871b2007e0f6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:29.468420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:29.469126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a77a3a34-78bd-4031-9a18-4b8295453ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:29.471033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1113/2196] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:29 2022] DELETE /identity/v3/projects/9306f786142149c5bc871b2007e0f6ef => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:29.476066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:29.477093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:29.482201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:29.541167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:29.543081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:29.704000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1084/2197] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:29.713192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:29.713708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:29.713968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:29.762546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:29.762546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:29.781543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1114/2198] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:29.786002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:29.800684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529407b-6869-4717-8703-3aac49ad1717 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:29.817477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:29.842970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:29.843308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:29.843614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:29.848476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:29.851833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:29.859211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:29.888824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1085/2199] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:29.893085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:29.904735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1a96-b0d6-452f-83af-6f5c287b736d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:29.912353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:29.914608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:29.914608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:29.914608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:29.915261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:29.916926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:30.104794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1115/2200] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:29 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:30.109301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.121406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2771e-2239-4603-a310-571a2fa3b394 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:30.188547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:30.189227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.189530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.189904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.190498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:30.192556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:30.405780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1086/2201] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:30 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:30.410036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.421195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e300-81de-4573-94b1-9cf6f8adaf32 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:30.426056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:30.426979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.427230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.427501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.428261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:30.430265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:30.449280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1116/2202] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:30.453379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.468766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef4ad-eb4d-421f-a4a0-fbe54d77b0ce admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:30.475305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:30.476236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.477890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.478319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.479234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:30.481100 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ec674-d355-480c-bfe5-8bae42a0edf2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:30.495659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1087/2203] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:30.499721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.515295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3280-4a22-45d8-89ac-86b5d3609c33 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:30.521358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:30.522267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.522673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.522948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] PATH_INFO: `/v3/projects/b1c21b69b41448eda4751a9d83c60d56/users/e8859d79ab924bb585b04f69f93ca211/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.546046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c21b69b41448eda4751a9d83c60d56, user_id=e8859d79ab924bb585b04f69f93ca211, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:30.553035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:30.683557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:30.692954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1117/2204] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:30 2022] PUT /identity/v3/projects/b1c21b69b41448eda4751a9d83c60d56/users/e8859d79ab924bb585b04f69f93ca211/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:30.696673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22530e-5a15-446d-930d-b1d4d7a33ba5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.697237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22530e-5a15-446d-930d-b1d4d7a33ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.697539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22530e-5a15-446d-930d-b1d4d7a33ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.736226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fa22530e-5a15-446d-930d-b1d4d7a33ba5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:30.738966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fa22530e-5a15-446d-930d-b1d4d7a33ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:30.862614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1088/2205] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:30.873544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.875399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:31.036324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09d8a-4b05-4287-9993-4bad3fafa9ad admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:31.040574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:31.041559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:31.041858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:31.042142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:31.052622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:31.054122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a8453-43b9-44a8-b0db-c7e3fd687e37 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:31.066727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1118/2206] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:31.681283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:31.681283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:31.681283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:31.691856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] MFA Rules not processed for user `2ed266f163ec4affa70580d2602d0720`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:31.693132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:31.752410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1089/2207] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:33.155646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:33.156430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:33.156735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:33.204861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] MFA Rules not processed for user `e8859d79ab924bb585b04f69f93ca211`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:33.206160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:33.282517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1119/2208] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:33.613381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:33.615560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:33.686272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3be54-29ab-4d1a-bbd8-2a5519d78d11 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:33.689412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:33.690087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:33.690372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:33.690650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:33.700741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:33.704475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f5d90-21b9-43ff-ad08-b36bd33039cd service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:33.717074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1090/2209] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:33.861630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:34.249375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:34.250866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:34.266525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abd32a-3270-4a8e-ac67-25aba5ac1ffd None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:34.271203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:34.272071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:34.272395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:34.272664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] PATH_INFO: `/v3/users/c2cdcc14c65749f8ad08272a9ecf270d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:34.273876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cdcc14c65749f8ad08272a9ecf270d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:34.275758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:34.851404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cdcc14c65749f8ad08272a9ecf270d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:34.870199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cdcc14c65749f8ad08272a9ecf270d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:34.877567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cdcc14c65749f8ad08272a9ecf270d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:34.878496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cdcc14c65749f8ad08272a9ecf270d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:34.879158 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cdcc14c65749f8ad08272a9ecf270d'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:34.964337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1120/2210] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:34 2022] DELETE /identity/v3/users/c2cdcc14c65749f8ad08272a9ecf270d => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:34.968960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:34.969458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:34.969568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:34.988088 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:34.989330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:35.075846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1091/2211] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:35.091591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:35.093190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:35.193080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00252af-e683-4ede-9be8-b84b276e174f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:35.197370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:35.198015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:35.198297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:35.198758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:35.210647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:35.212259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:35.222677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1121/2212] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:35.799480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:35.801174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:35.820983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64e5a-5ee8-4800-9ce1-3a22cfc203f3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:35.826232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:35.830969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:35.830969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:35.830969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] PATH_INFO: `/v3/users/cf02d583d52d4e1eace1759aa7f1dda4` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:35.830969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf02d583d52d4e1eace1759aa7f1dda4)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:35.831378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:35.846390 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:35.848139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:35.862193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9910aa1-d7c9-4619-a6bb-b4e953d6b14f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:35.887617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:35.889765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:35.890262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:35.891143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] PATH_INFO: `/v3/projects/1b4b09f3747e44369533a5f477a11a49` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:35.892695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4b09f3747e44369533a5f477a11a49)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:35.895688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:36.101085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4b09f3747e44369533a5f477a11a49', 'request_id': 'req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.101261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf02d583d52d4e1eace1759aa7f1dda4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.115528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf02d583d52d4e1eace1759aa7f1dda4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.116396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf02d583d52d4e1eace1759aa7f1dda4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.117966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf02d583d52d4e1eace1759aa7f1dda4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.126571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-75b0a7ff-e28c-4baf-b9a1-c77e23677676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf02d583d52d4e1eace1759aa7f1dda4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.272936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4b09f3747e44369533a5f477a11a49', 'request_id': 'req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.283015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4b09f3747e44369533a5f477a11a49', 'request_id': 'req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.303403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] The token cache is being invalidate because project 1b4b09f3747e44369533a5f477a11a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:36.303403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.304534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8bcb22a5-3960-4fd7-90ad-9a06867f22a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:36.309975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1122/2213] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:35 2022] DELETE /identity/v3/projects/1b4b09f3747e44369533a5f477a11a49 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:36.311493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b708b-a243-47c8-a529-e8efa19063ca None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.311964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b708b-a243-47c8-a529-e8efa19063ca None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.312376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b708b-a243-47c8-a529-e8efa19063ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.345478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7c5b708b-a243-47c8-a529-e8efa19063ca None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:36.352677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7c5b708b-a243-47c8-a529-e8efa19063ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:36.382997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1092/2214] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:35 2022] DELETE /identity/v3/users/cf02d583d52d4e1eace1759aa7f1dda4 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:36.387436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.387938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.388386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.409829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:36.412011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:36.433711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1123/2215] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:36.442024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.442794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.443128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.468804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:36.475567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:36.495298 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1093/2216] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:36.511350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:36.514175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:36.556614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1124/2217] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:36.561092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:36.574539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deda3d1-664f-4707-baa8-2c7f7a2cd9bb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:36.580915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:36.581706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.583316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.583783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.584654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:36.585025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:36.587378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:36.607476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1125/2218] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:20:36.609657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:36.614784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe15bd-d874-4578-81fb-1b46b667a71b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:36.620242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:36.621370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.621838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.622288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.623312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413be69-51a2-488f-81d5-67238619146d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:36.630418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:36.631896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.635693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.635693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.635693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:36.636068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:36.636284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:36.639029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dece7-5013-4179-bf44-59f9a96b0906 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:36.658376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1094/2219] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:36.717942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.718442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.718912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.741853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] MFA Rules not processed for user `e8859d79ab924bb585b04f69f93ca211`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:36.742952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:36.793433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1126/2220] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:36.797920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:36.854672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1095/2221] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:36.885430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8dc9-be93-4d8e-8e22-657f377832e7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:36.890378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:36.891047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:36.891424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:36.891714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:36.892435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:36.895486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:36.919882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:36.922115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:37.015070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a68f-151a-49c2-ab5f-a6e37e0f9f3b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.073050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1127/2222] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:36 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:37.074252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:37.104897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.109278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.109278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.109278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.110722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:37.118060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:37.124095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52ad95-aff7-43a2-8cda-bef314cb60a1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.150566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.152471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.152949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.154614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.157434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.168627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.197947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1128/2223] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:37.199531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:37.215329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83390-cc1d-48e4-bc66-821547136b19 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.220790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.222957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.226634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.227486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.227782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.228060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.228877 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.232985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164aa29-5e32-4894-82dd-6d906ac0b7c8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.245625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1096/2224] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:37.273144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1129/2225] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:37.278665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:37.301898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6936-00f4-43e2-aa06-4c8c788f0a24 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.315540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.315540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.315540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.315540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] PATH_INFO: `/v3/projects/87d93fa8d09d478a9993a271ff089ae7/users/6d1b977fe42941c2a99a7884d3318104/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.353559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d93fa8d09d478a9993a271ff089ae7, user_id=6d1b977fe42941c2a99a7884d3318104, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.356745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.508645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1097/2226] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:37 2022] PUT /identity/v3/projects/87d93fa8d09d478a9993a271ff089ae7/users/6d1b977fe42941c2a99a7884d3318104/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:37.523900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.524498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.524988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.575036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] MFA Rules not processed for user `6d1b977fe42941c2a99a7884d3318104`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:37.576383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:37.649271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:37.649271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:37.662674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1130/2227] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:37.676392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:37.677783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:37.763573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491b9f-0dc6-4ecc-86eb-07c4e974f1dc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.763869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786cc42-31c9-4a7f-8041-b44f8b624e0a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:37.774348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.774348 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.774624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:37.774746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.774746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.774912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:37.774912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:37.774912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] PATH_INFO: `/v3/projects/23abc7bfa19c4bc491a53a2ec76c73a1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:37.776265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23abc7bfa19c4bc491a53a2ec76c73a1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.778649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.787638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:37.789560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492d848-4c7b-4ba1-a2ca-0823575d6bd8 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:37.799953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1131/2228] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:38.155462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23abc7bfa19c4bc491a53a2ec76c73a1', 'request_id': 'req-8ec89535-9079-4b97-89a1-a47544ed89dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:38.298792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23abc7bfa19c4bc491a53a2ec76c73a1', 'request_id': 'req-8ec89535-9079-4b97-89a1-a47544ed89dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:38.317802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23abc7bfa19c4bc491a53a2ec76c73a1', 'request_id': 'req-8ec89535-9079-4b97-89a1-a47544ed89dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:38.354529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] The token cache is being invalidate because project 23abc7bfa19c4bc491a53a2ec76c73a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:38.358303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:38.362224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8ec89535-9079-4b97-89a1-a47544ed89dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:38.368505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1098/2229] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:37 2022] DELETE /identity/v3/projects/23abc7bfa19c4bc491a53a2ec76c73a1 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:38.371135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:38.371633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:38.371741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:38.408090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:38.411019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:38.490066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1132/2230] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:38.498349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:38.498633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:38.498911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:38.525217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:38.526466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:38.560171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1099/2231] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:38.564588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:38.579289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d362d-495c-4705-8652-55bb2bb645d2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:38.588023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:38.589248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:38.589809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:38.590244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:38.591387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:38.591723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:38.593442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:38.608898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1133/2232] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:38.613101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:38.624307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a223842-6cb9-436a-afe6-b017695001fb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:38.629797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:38.630456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:38.639599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:38.639599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:38.639599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:38.639599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:38.739849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1100/2233] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:38.746632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:38.758634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea074fa-793e-4f4c-b34b-2226c0443763 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:38.849971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:38.850654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:38.850933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:38.851203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:38.851997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:38.854009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.015347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1134/2234] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:38 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:39.016035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.033954 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd210b1e-4f33-4f2c-a451-8c9e16ea8d1f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.039716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.040803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.041116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.041615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.042494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.044282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.065463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.066041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1101/2235] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:39.088157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4decc-846a-4f26-9ec9-ad768bd4dd03 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.097468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.099431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.099431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.099431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.100190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.103094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fee0c4-d6c3-47bf-8f47-1e748d711c86 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.118867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1135/2236] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:39.122911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.134353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b55a7-1f08-4102-a76f-0bf11a4c2145 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.139239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.140127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.140438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.140712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] PATH_INFO: `/v3/projects/93038b675ac240458faf4bdef0bcca92/users/eeca5fb558314614a49c3ce2f45189b8/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.160586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93038b675ac240458faf4bdef0bcca92, user_id=eeca5fb558314614a49c3ce2f45189b8, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.164132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.194118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:39.320037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1102/2237] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:39 2022] PUT /identity/v3/projects/93038b675ac240458faf4bdef0bcca92/users/eeca5fb558314614a49c3ce2f45189b8/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:39.332184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.333245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.333245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.377853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] MFA Rules not processed for user `eeca5fb558314614a49c3ce2f45189b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:39.379944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:39.530078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1136/2238] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:39.537457 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.614535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aa0d-0aaa-4870-b059-9bc83501b643 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.620096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.625323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.625323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.625323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.625323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.625323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.816344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1103/2239] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:39 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:39.818305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.832776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f9c36-723e-466c-9a21-5728182c367f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.946726 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.947882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.948131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.948471 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.950814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.956245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.141476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.142525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1137/2240] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:39 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:40.153885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed73b0-72ab-40cb-9a34-8c8a371672a4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.165704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.166985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.166985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.167313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.170246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.172148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.190377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1104/2241] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:40.192992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.207839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be982-00b9-49a6-bf18-03f432d80eca admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.213829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.215016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.215512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.216441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.218898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.222982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a81e-95cc-4755-9bb1-e7fbf88b4f1e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.251112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1138/2242] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:40.256475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.271007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05584f38-d747-4508-80c2-09ea567e94af admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.277156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.278058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.278517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.278798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] PATH_INFO: `/v3/projects/a1100a630f504a2c838d442b0f595010/users/4f92dd67c66740f7a149e1490a77fa78/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.315562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1100a630f504a2c838d442b0f595010, user_id=4f92dd67c66740f7a149e1490a77fa78, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.319439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.423630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1105/2243] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:40 2022] PUT /identity/v3/projects/a1100a630f504a2c838d442b0f595010/users/4f92dd67c66740f7a149e1490a77fa78/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:40.434853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.438588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.438588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.469292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] MFA Rules not processed for user `4f92dd67c66740f7a149e1490a77fa78`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:40.470685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:40.596347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1139/2244] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:40.600994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.679399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf1c-3697-47fc-949b-744e6258dfc3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.684578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.685381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.685673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.685948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.686687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.689223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.775842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.778009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:40.799306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3dab-0bf1-4125-bc82-aee4758124f6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.805324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.806196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.806475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.806751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] PATH_INFO: `/v3/users/0ba2eae4521c4a73938ea2033662b8b5` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.808340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba2eae4521c4a73938ea2033662b8b5)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.810276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.864255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1106/2245] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:40 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:40.869390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.938372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ac2f-56b7-476d-ba15-a2382632f0fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.955596 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.956322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.956613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.956891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.957679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.959827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ee252-39a6-4f28-820f-9fec8b364751 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.114283 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1107/2246] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:40 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:41.115874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.116165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.116630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.124960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba2eae4521c4a73938ea2033662b8b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:41.137120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] MFA Rules not processed for user `cec8659660e344109a2f8618db492f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:41.145031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.145833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba2eae4521c4a73938ea2033662b8b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:41.148404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba2eae4521c4a73938ea2033662b8b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:41.152907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba2eae4521c4a73938ea2033662b8b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:41.153561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dc69c23-ad02-4449-ac8c-a99df899e1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba2eae4521c4a73938ea2033662b8b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:41.201204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1108/2247] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:41.202144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.208236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.223684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679ecc-2b64-4da4-9b31-f31695e466bb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.235896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.235896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.235896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.235896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.236238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:41.236238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.245526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1109/2248] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:41.249568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.260864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f7d-18c1-48b4-b588-1c8929dca468 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.266462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.267423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.267774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.268240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] PATH_INFO: `/v3/projects/19c80e58a31245d09cac2fe74dbd7de6/users/9159c1d4eb3f4b70a7ce2f2823e2e23a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.284622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c80e58a31245d09cac2fe74dbd7de6, user_id=9159c1d4eb3f4b70a7ce2f2823e2e23a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:41.289347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.298685 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1140/2249] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:40 2022] DELETE /identity/v3/users/0ba2eae4521c4a73938ea2033662b8b5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:41.302961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.303248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.303523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.322440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:41.323693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.390458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1141/2250] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:41.401165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.403492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.419123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1110/2251] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:41 2022] PUT /identity/v3/projects/19c80e58a31245d09cac2fe74dbd7de6/users/9159c1d4eb3f4b70a7ce2f2823e2e23a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:41.422131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.484585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbc5d-9fa9-427e-8505-64938ef1491f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.497024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba869d0-5082-4f1e-b794-3cf0fa418b80 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.502048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.502851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.503353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.503743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.504698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:41.506530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.520188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1111/2252] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:41.524783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.537997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d66a-a6fb-4c31-a744-f859a31ab4d7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.560303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.560303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.560303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.560634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.560723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] PATH_INFO: `/v3/projects/19c80e58a31245d09cac2fe74dbd7de6/users/9159c1d4eb3f4b70a7ce2f2823e2e23a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.560804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.560804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.560804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.560996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c80e58a31245d09cac2fe74dbd7de6, user_id=9159c1d4eb3f4b70a7ce2f2823e2e23a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:41.560996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2b6f-d3df-4a9f-ac76-8d8143abf91a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.568769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:41.570218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1112/2253] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:41 2022] PUT /identity/v3/projects/19c80e58a31245d09cac2fe74dbd7de6/users/9159c1d4eb3f4b70a7ce2f2823e2e23a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:41.579507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:41.582688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1142/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:41.584606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.585044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.585509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.632368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] MFA Rules not processed for user `9159c1d4eb3f4b70a7ce2f2823e2e23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:41.634191 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.712726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1113/2255] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:41.724180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:41.727838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:41.799771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806dee6-76a7-4bf4-b8e6-3194b2b7d068 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:41.866557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:41.867773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:41.868298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:41.868581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:41.872175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:42.013452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:42.015778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:42.029157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1143/2256] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:42.212373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:42.212373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:42.330664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:42.386302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148f63-d7fc-4afb-a6d5-8a7e26d77348 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:42.396297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:42.398789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:42.399820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:42.400165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] PATH_INFO: `/v3/projects/44d7f4b422314fe69a12a011dc1b6a7e` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:42.405371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d7f4b422314fe69a12a011dc1b6a7e)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:42.409476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:42.445724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:42.593170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d7f4b422314fe69a12a011dc1b6a7e', 'request_id': 'req-b14095aa-1ccb-4402-91f0-1ea49507da11'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:42.742521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d7f4b422314fe69a12a011dc1b6a7e', 'request_id': 'req-b14095aa-1ccb-4402-91f0-1ea49507da11'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:42.750991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d7f4b422314fe69a12a011dc1b6a7e', 'request_id': 'req-b14095aa-1ccb-4402-91f0-1ea49507da11'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:42.763294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] The token cache is being invalidate because project 44d7f4b422314fe69a12a011dc1b6a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:42.765387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:42.765387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:42.765917 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1114/2257] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:42 2022] DELETE /identity/v3/projects/44d7f4b422314fe69a12a011dc1b6a7e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:42.770930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:42.786022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce6e4-a88a-48e1-957a-2ec5ec7d4bb3 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:42.846027 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:42.846929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:42.847320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:42.848287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] PATH_INFO: `/v3/users/205971ca4ce94ed7be98aba779c6ea22` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:42.849681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=205971ca4ce94ed7be98aba779c6ea22)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:42.852708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:43.208748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205971ca4ce94ed7be98aba779c6ea22'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:43.230580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205971ca4ce94ed7be98aba779c6ea22'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:43.239199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205971ca4ce94ed7be98aba779c6ea22'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:43.239958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205971ca4ce94ed7be98aba779c6ea22'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:43.240604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-076c0b29-611f-457d-9ee5-3cf93b9576fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205971ca4ce94ed7be98aba779c6ea22'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:43.344492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1144/2258] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:42 2022] DELETE /identity/v3/users/205971ca4ce94ed7be98aba779c6ea22 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:44.063185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:44.064853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:44.083131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14095aa-1ccb-4402-91f0-1ea49507da11 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:44.167140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:44.168618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:44.168871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:44.169070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] PATH_INFO: `/v3/projects/49bcb4edd9514cee806c521873cbbe3f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:44.170313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bcb4edd9514cee806c521873cbbe3f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:44.172276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:44.367377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bcb4edd9514cee806c521873cbbe3f', 'request_id': 'req-eb09b393-cc2c-4c26-97eb-6392324616e1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:44.495962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bcb4edd9514cee806c521873cbbe3f', 'request_id': 'req-eb09b393-cc2c-4c26-97eb-6392324616e1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:44.507010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bcb4edd9514cee806c521873cbbe3f', 'request_id': 'req-eb09b393-cc2c-4c26-97eb-6392324616e1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:44.521467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] The token cache is being invalidate because project 49bcb4edd9514cee806c521873cbbe3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:44.521763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:44.522465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:44.528397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1115/2259] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:44 2022] DELETE /identity/v3/projects/49bcb4edd9514cee806c521873cbbe3f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:44.538554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:44.540070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:44.540388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:44.596491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:44.597201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:44.665893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:44.667291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:44.775883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b393-cc2c-4c26-97eb-6392324616e1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:44.782629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:44.784718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:44.786414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:44.786793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] PATH_INFO: `/v3/users/a90e540188034e138f9af9e6159c89bf` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:44.788240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90e540188034e138f9af9e6159c89bf)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:44.791932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:44.819843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1145/2260] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:44.826755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:44.826755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:44.923520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343af0-da15-4e57-8036-ee221961d8e8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:44.928218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:44.928999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:44.929414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:44.929790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:44.931799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:45.020926 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.022537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da900c-eb80-4245-ae7d-b5ac7788cf61 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.033839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1146/2261] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:45.035350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.035645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.036097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.055954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:45.057381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:45.065873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1147/2262] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:45.069845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.071627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90e540188034e138f9af9e6159c89bf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:45.080137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc26ec-191e-45c7-b475-c217cf7fff36 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.090246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90e540188034e138f9af9e6159c89bf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:45.090712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.091550 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90e540188034e138f9af9e6159c89bf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:45.091924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.092541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90e540188034e138f9af9e6159c89bf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:45.092787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.093257 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.094532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:45.094851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.096553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.101414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c4691335-052a-4fb9-b8cb-868d3eb003ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90e540188034e138f9af9e6159c89bf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:45.115114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1148/2263] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:20:45.120577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.123249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:45.149804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23806-2ef3-4fc2-9a9f-076dff890830 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.155065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.155794 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.156019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.156333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.157049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.159119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.219706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1116/2264] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:44 2022] DELETE /identity/v3/users/a90e540188034e138f9af9e6159c89bf => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:45.224482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.224920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.225313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.247246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:45.248646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:45.310799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1149/2265] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:45 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:45.312279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.391171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1117/2266] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:45.397044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.401566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:45.423256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5aa80-881a-4cc6-87bc-e47f18e3ff55 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.429409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.430528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.430528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.432765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.432765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.435876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.567389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b68850-add7-4342-891d-665709b9bfd2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.576454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1150/2267] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:45 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:45.577459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.591977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561298e-07fd-4362-a59a-0bbe1bca7203 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.609701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.614283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.614575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.615891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.616712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.623569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.665899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.667035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.667509 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.668103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.682995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.685223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.687620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1151/2268] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:45.696295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.699618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1118/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:45.722695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133296e-4d7f-49bf-a801-9b9d31e3c961 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.730897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.732552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.732552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.732552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.734030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.735689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e2f0-70e1-4043-8501-f44fa2f62c13 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:45.752099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1152/2270] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:45.754228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:45.825528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1726-299b-479e-bc9b-90ba4e1c33a8 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:45.852427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:45.853692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:45.853974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:45.854244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] PATH_INFO: `/v3/projects/10174b94907843c595728a3bea82be7d/users/4de68dfa14284dcebc7223764a4878d6/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:45.906907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10174b94907843c595728a3bea82be7d, user_id=4de68dfa14284dcebc7223764a4878d6, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:45.912475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:46.101018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1119/2271] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:45 2022] PUT /identity/v3/projects/10174b94907843c595728a3bea82be7d/users/4de68dfa14284dcebc7223764a4878d6/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:46.107448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.107740 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.108689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.139805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] MFA Rules not processed for user `4de68dfa14284dcebc7223764a4878d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:46.141065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:46.215544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1153/2272] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:46.220090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:46.303883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb570-6191-4abb-a956-89ab0cb2f40d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:46.309663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:46.310399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.310684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.310953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.311642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:46.313874 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:46.542712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1120/2273] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:46 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:46.546969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:46.558953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd99a70-a5b3-4ed3-a125-deae54c0b49d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:46.636439 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:46.637133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.637417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.637690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.638399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:46.640441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:46.652296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:46.666170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:46.677544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671283d5-ccd9-468e-a722-55774277b061 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:46.685368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:46.686536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.687028 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.687526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] PATH_INFO: `/v3/projects/1e7d8551c6bc4113976e71ea8b86b429` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.689118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7d8551c6bc4113976e71ea8b86b429)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:46.691478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:46.788336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1154/2274] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:46 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:46.789833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:46.807505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6c91-c2b1-456c-965c-20d3c576bac1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:46.813881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:46.815201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.815201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.815455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.816494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:46.818480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:46.834865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1155/2275] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:46.836552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7d8551c6bc4113976e71ea8b86b429', 'request_id': 'req-df23dc56-7b73-44df-8107-32596994a80f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:46.839759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:46.855169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2eb9b-0261-48eb-ad2e-1493df150196 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:46.926539 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7d8551c6bc4113976e71ea8b86b429', 'request_id': 'req-df23dc56-7b73-44df-8107-32596994a80f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:46.952678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7d8551c6bc4113976e71ea8b86b429', 'request_id': 'req-df23dc56-7b73-44df-8107-32596994a80f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:46.952845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:46.952845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:46.952845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:46.954420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] PATH_INFO: `/v3/projects/458709ac4b1844e69dcc7ac07c829dcd/users/3ab0e90685f146d6875113152af5c515/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:46.994438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] The token cache is being invalidate because project 1e7d8551c6bc4113976e71ea8b86b429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:46.996043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:46.999693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.002225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1121/2276] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:46 2022] DELETE /identity/v3/projects/1e7d8551c6bc4113976e71ea8b86b429 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:47.005869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:47.006281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458709ac4b1844e69dcc7ac07c829dcd, user_id=3ab0e90685f146d6875113152af5c515, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.007720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.009094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.026142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23dc56-7b73-44df-8107-32596994a80f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:47.040288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:47.041361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.041753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.042129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] PATH_INFO: `/v3/users/76cfb8c115bd48a48cedfaf337cf413a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.043923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76cfb8c115bd48a48cedfaf337cf413a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.047958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.084162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:47.131876 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1156/2277] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:46 2022] PUT /identity/v3/projects/458709ac4b1844e69dcc7ac07c829dcd/users/3ab0e90685f146d6875113152af5c515/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:47.136452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:47.138200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.212808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309595f8-5001-4d31-b93d-393d57c2e802 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:47.231411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:47.231411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.231411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.231411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.232681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.236387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.255230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1157/2278] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:47.256521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:47.286049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d54e13-2e91-4832-913b-5848e5912881 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:47.293132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:47.294228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.294513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.294790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] PATH_INFO: `/v3/projects/458709ac4b1844e69dcc7ac07c829dcd/users/3ab0e90685f146d6875113152af5c515/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.296956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458709ac4b1844e69dcc7ac07c829dcd, user_id=3ab0e90685f146d6875113152af5c515, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.300501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f656f9-336d-4686-8840-d2f2d5f80ee6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.315396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1158/2279] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:47 2022] PUT /identity/v3/projects/458709ac4b1844e69dcc7ac07c829dcd/users/3ab0e90685f146d6875113152af5c515/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:47.328452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.328835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.329273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.374838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:47.437334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] MFA Rules not processed for user `3ab0e90685f146d6875113152af5c515`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:47.437334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.531147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1159/2280] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:47.542377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:47.543774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.550003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76cfb8c115bd48a48cedfaf337cf413a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.576706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76cfb8c115bd48a48cedfaf337cf413a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.577758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76cfb8c115bd48a48cedfaf337cf413a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.591853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76cfb8c115bd48a48cedfaf337cf413a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.612767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76cfb8c115bd48a48cedfaf337cf413a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:47.629321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f97e4-2820-4392-b3ed-bd4f92a0ab70 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:47.635075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:47.635808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.636151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.636541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.639157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.651718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.653164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.663061 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1160/2281] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:47.693314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:47.702023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.705953 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5218e3-73f2-47ea-991f-634659f867ab service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:47.711897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:47.712590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:47.712868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:47.713137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:47.714991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:47.741991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1122/2282] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:47 2022] DELETE /identity/v3/users/76cfb8c115bd48a48cedfaf337cf413a => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:47.784328 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:47.785986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7ae22-a6ff-43cb-acf4-495f9384ceb1 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:47.799586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1161/2283] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:48.227083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:48.228592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:48.306805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fd10-9d1f-4cd5-9f47-b741d1f1fc09 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:48.332464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:48.333521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:48.333801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:48.334292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] PATH_INFO: `/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:48.335938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a85ce92b64473895e2ad4c3ceed4a1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:48.338372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:48.569694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a85ce92b64473895e2ad4c3ceed4a1', 'request_id': 'req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:48.701312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a85ce92b64473895e2ad4c3ceed4a1', 'request_id': 'req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:48.713740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a85ce92b64473895e2ad4c3ceed4a1', 'request_id': 'req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:48.727117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] The token cache is being invalidate because project 93a85ce92b64473895e2ad4c3ceed4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:48.727559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:48.728426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-bc2b0f8b-1bab-4a8e-b421-5e94118a43d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:48.730356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1123/2284] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:48 2022] DELETE /identity/v3/projects/93a85ce92b64473895e2ad4c3ceed4a1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:48.736551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:48.737091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:48.737184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:48.756485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:48.758415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:48.828636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1162/2285] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:48.837889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:48.838179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:48.838455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:48.867533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:48.868757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:48.876837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1124/2286] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:48.881015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:48.891602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360aae-4c20-400b-9707-881b9b700aeb None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:48.896323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:48.897005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:48.897290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:48.897566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:48.898980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:48.899243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:48.900935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:48.912599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1163/2287] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:48.917260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:48.926819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337537f-8fc0-45f7-af76-d181a44117b6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:48.931777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:48.932483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:48.932769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:48.938564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:48.938564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:48.938564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.063578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1125/2288] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:48 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:49.064833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:49.078870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61417f8-06b5-4bc3-b9fe-58c34b2331fe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:49.148919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:49.149828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.150194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.150551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.152117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:49.154260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.301183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1164/2289] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:49 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:49.306096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:49.316934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e52df-329f-48b1-a1dd-3613f504af64 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:49.328662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:49.329680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.329902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.330177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.330904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:49.332581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.365385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1126/2290] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:49.370011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:49.386273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0592-fe8f-4c9c-8f78-2d8667956c36 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:49.409346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:49.413245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.414746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.417975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.419166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:49.422087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ece0-9406-4e02-9232-bf2cf17f437f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.435744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1165/2291] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:49.439930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:49.450679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f5fe-edbd-403f-9cce-1a07ab1d39b8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:49.468110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:49.469752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.470227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.470686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] PATH_INFO: `/v3/projects/565090ed2d3d41258a4d703c31100bf8/users/dda91c77f7984cc2ac41268fe15b0c94/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.504081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=565090ed2d3d41258a4d703c31100bf8, user_id=dda91c77f7984cc2ac41268fe15b0c94, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:49.508102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.688752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1127/2292] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:49 2022] PUT /identity/v3/projects/565090ed2d3d41258a4d703c31100bf8/users/dda91c77f7984cc2ac41268fe15b0c94/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:49.696699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.697073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.697433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.738425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] MFA Rules not processed for user `dda91c77f7984cc2ac41268fe15b0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:49.739650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:49.825599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1166/2293] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:49.839337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:49.841080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:49.905884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58446-3e16-43f4-aa27-dd98a8a48b9e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:49.910408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:49.911156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:49.911514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:49.911790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:49.932079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:49.933655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:49.943229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1128/2294] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:52.822673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:53.113217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:53.388066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:53.389661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:53.473919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d788-fdc3-494a-b31f-a4896a779394 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:53.480157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:53.481616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:53.482336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:53.482646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] PATH_INFO: `/v3/users/4de68dfa14284dcebc7223764a4878d6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:53.489430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de68dfa14284dcebc7223764a4878d6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:53.492891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:53.858026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de68dfa14284dcebc7223764a4878d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:53.876630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de68dfa14284dcebc7223764a4878d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:53.885007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de68dfa14284dcebc7223764a4878d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:53.885727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de68dfa14284dcebc7223764a4878d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:53.886359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2dcdf557-e1e4-4042-883c-9e5e39a484c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de68dfa14284dcebc7223764a4878d6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:53.902831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:53.904289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:53.918551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3fe3-538f-46b2-8b71-edd8069a4a4b service glance] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:53.923051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:53.923983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:53.924249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:53.924523 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] PATH_INFO: `/v3/users/eeca5fb558314614a49c3ce2f45189b8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:53.925696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeca5fb558314614a49c3ce2f45189b8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:53.927606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:53.975751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1167/2295] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:53 2022] DELETE /identity/v3/users/4de68dfa14284dcebc7223764a4878d6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:53.980821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:53.981116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:53.981466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:54.000041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:54.001382 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:54.074541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1168/2296] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:54.085657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:54.087119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:54.144350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c2106-50c9-47c3-b502-2fecd363877e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:54.148174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:54.148873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:54.149156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:54.149457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:54.158959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:54.160534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868b1e-c5ef-470f-8ab5-7ab652da9baf service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:54.170939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1169/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:20:54.200853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeca5fb558314614a49c3ce2f45189b8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:54.213918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeca5fb558314614a49c3ce2f45189b8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:54.214633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeca5fb558314614a49c3ce2f45189b8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:54.215235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeca5fb558314614a49c3ce2f45189b8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:54.222414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeca5fb558314614a49c3ce2f45189b8'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:54.432750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1129/2298] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:53 2022] DELETE /identity/v3/users/eeca5fb558314614a49c3ce2f45189b8 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:54.437273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:54.437762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:54.438040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:54.468798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:54.481619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:54.545434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1170/2299] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:54.557993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:54.559198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:54.630212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7930-e20d-4439-87e0-71c74d2a45a0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:54.640952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:54.641727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:54.642219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:54.642711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:54.653633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:54.655432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:54.666740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1130/2300] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:54.750446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:54.751922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:54.766535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa509-a845-4c38-8f32-c0cb56e52bf8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:54.778456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:54.778665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:54.778915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:54.779274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] PATH_INFO: `/v3/projects/10174b94907843c595728a3bea82be7d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:54.781494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=10174b94907843c595728a3bea82be7d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:54.784359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:55.013335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10174b94907843c595728a3bea82be7d', 'request_id': 'req-adb56459-cb30-4010-86ca-f5ddd8bee9ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.159443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10174b94907843c595728a3bea82be7d', 'request_id': 'req-adb56459-cb30-4010-86ca-f5ddd8bee9ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.169163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10174b94907843c595728a3bea82be7d', 'request_id': 'req-adb56459-cb30-4010-86ca-f5ddd8bee9ec'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.184641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] The token cache is being invalidate because project 10174b94907843c595728a3bea82be7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:55.185083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.185875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.187780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1171/2301] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:54 2022] DELETE /identity/v3/projects/10174b94907843c595728a3bea82be7d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:55.191766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:55.209885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148edede-227f-4b53-b6fd-ce1eac85610a service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:55.289758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:55.290714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:55.291000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:55.291277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] PATH_INFO: `/v3/users/3ab0e90685f146d6875113152af5c515` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:55.293084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab0e90685f146d6875113152af5c515)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:55.297775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:55.428658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:55.430732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:55.453705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56459-cb30-4010-86ca-f5ddd8bee9ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:55.460887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:55.461785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:55.462107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:55.462396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] PATH_INFO: `/v3/projects/93038b675ac240458faf4bdef0bcca92` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:55.463632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93038b675ac240458faf4bdef0bcca92)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:55.465655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:55.687555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab0e90685f146d6875113152af5c515'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.691178 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93038b675ac240458faf4bdef0bcca92', 'request_id': 'req-1938125a-d278-463e-aaac-10163536ce3a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.700260 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab0e90685f146d6875113152af5c515'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.701031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab0e90685f146d6875113152af5c515'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.701660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab0e90685f146d6875113152af5c515'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.709231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab0e90685f146d6875113152af5c515'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.832836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93038b675ac240458faf4bdef0bcca92', 'request_id': 'req-1938125a-d278-463e-aaac-10163536ce3a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.841464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93038b675ac240458faf4bdef0bcca92', 'request_id': 'req-1938125a-d278-463e-aaac-10163536ce3a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.853488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] The token cache is being invalidate because project 93038b675ac240458faf4bdef0bcca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:55.853807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.854484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:55.856088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1172/2302] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:55 2022] DELETE /identity/v3/projects/93038b675ac240458faf4bdef0bcca92 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:55.860080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:55.861585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:55.938519 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938125a-d278-463e-aaac-10163536ce3a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:55.943494 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:55.944563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:55.944800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:55.945078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] PATH_INFO: `/v3/users/4f92dd67c66740f7a149e1490a77fa78` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:55.946888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f92dd67c66740f7a149e1490a77fa78)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:55.948961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:55.988800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1131/2303] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:55 2022] DELETE /identity/v3/users/3ab0e90685f146d6875113152af5c515 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:56.224379 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f92dd67c66740f7a149e1490a77fa78'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:56.244486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f92dd67c66740f7a149e1490a77fa78'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:56.252371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f92dd67c66740f7a149e1490a77fa78'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:56.253108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f92dd67c66740f7a149e1490a77fa78'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:56.253708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f92dd67c66740f7a149e1490a77fa78'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:56.423580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1173/2304] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:55 2022] DELETE /identity/v3/users/4f92dd67c66740f7a149e1490a77fa78 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:56.784619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:56.787131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:56.910396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090ed4f-5848-4287-a8fd-99c36abcae01 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:57.014592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:57.015638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.016014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.016447 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] PATH_INFO: `/v3/projects/458709ac4b1844e69dcc7ac07c829dcd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.017937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458709ac4b1844e69dcc7ac07c829dcd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:57.020590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:57.272646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:57.275216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:57.277084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458709ac4b1844e69dcc7ac07c829dcd', 'request_id': 'req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.308263 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966145f-f251-4bd9-8e04-b8959699b4f7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:57.399112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:57.399991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.400304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.400657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] PATH_INFO: `/v3/projects/a1100a630f504a2c838d442b0f595010` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.403327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1100a630f504a2c838d442b0f595010)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:57.405148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:57.482474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458709ac4b1844e69dcc7ac07c829dcd', 'request_id': 'req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.489334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458709ac4b1844e69dcc7ac07c829dcd', 'request_id': 'req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.500385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] The token cache is being invalidate because project 458709ac4b1844e69dcc7ac07c829dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:57.500663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.501337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-a5647d7e-474b-4ac7-a2c2-5e5869d8fa95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.502975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1132/2305] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:56 2022] DELETE /identity/v3/projects/458709ac4b1844e69dcc7ac07c829dcd => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:57.508529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb281e-903d-4ecd-8fad-57d38fd7bff0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.508817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb281e-903d-4ecd-8fad-57d38fd7bff0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.509095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb281e-903d-4ecd-8fad-57d38fd7bff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.527976 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-7ccb281e-903d-4ecd-8fad-57d38fd7bff0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:57.529270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7ccb281e-903d-4ecd-8fad-57d38fd7bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:57.547261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1133/2306] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:57.566279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.566556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.566830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.600146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1100a630f504a2c838d442b0f595010', 'request_id': 'req-521541a3-a31f-4ec6-98d8-11a078310b0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.613037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:57.614567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:57.678952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1100a630f504a2c838d442b0f595010', 'request_id': 'req-521541a3-a31f-4ec6-98d8-11a078310b0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.697664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1100a630f504a2c838d442b0f595010', 'request_id': 'req-521541a3-a31f-4ec6-98d8-11a078310b0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.727499 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] The token cache is being invalidate because project a1100a630f504a2c838d442b0f595010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:57.727804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.729888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:57.740872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1134/2307] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:57.740978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1174/2308] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:57 2022] DELETE /identity/v3/projects/a1100a630f504a2c838d442b0f595010 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:57.742534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:57.744024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:57.745559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:57.749208 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:57.764861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bdb9c-11df-4166-a443-ac6ef3c6908f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:57.772176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521541a3-a31f-4ec6-98d8-11a078310b0e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:57.783960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:57.787870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.787870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.787870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] PATH_INFO: `/v3/users/9159c1d4eb3f4b70a7ce2f2823e2e23a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.789388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:57.789529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9159c1d4eb3f4b70a7ce2f2823e2e23a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:57.789633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.789633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.789633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.789633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:57.789936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:57.791498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:57.791701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:57.806276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1175/2309] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:57.820977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:57.835128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd644-b452-46cb-b03a-61719c968679 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:57.840144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:57.840835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:57.841109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:57.841377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:57.842223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:57.844097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:57.998078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1176/2310] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:57 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:58.007197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.081584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e5ad-5b59-4252-9597-bbb2b4849eb1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.086885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:58.087557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.087840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.088112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.088832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:58.090865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:58.118631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:58.132331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9159c1d4eb3f4b70a7ce2f2823e2e23a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:58.144510 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9159c1d4eb3f4b70a7ce2f2823e2e23a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:58.145332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9159c1d4eb3f4b70a7ce2f2823e2e23a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:58.145923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9159c1d4eb3f4b70a7ce2f2823e2e23a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:58.153441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9159c1d4eb3f4b70a7ce2f2823e2e23a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:58.205852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1177/2311] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:58 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:58.211023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.213254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:58.227697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03508c8a-9c20-4b90-b03d-ddca9200be44 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.232994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:58.233679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.234633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.234920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.235674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:58.237341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:58.248362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1178/2312] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:58.259938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.260549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1135/2313] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:20:57 2022] DELETE /identity/v3/users/9159c1d4eb3f4b70a7ce2f2823e2e23a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:58.271951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5a34-3edc-424f-9a42-ebadfe670496 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.340761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:58.341451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.341741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.342098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.342825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:58.344539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd40e11-0376-4f1b-b49c-e67456843fde admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:58.356795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1179/2314] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:58.361061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.372524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acec0c-acdf-440f-994e-ba624ccb6df7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.380397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:58.383444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.383738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.384013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] PATH_INFO: `/v3/projects/dbb417d7f5b443109eb892fc52fedde9/users/6fc4c21e2ae04b659f0bbc4ba3a02295/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.405215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb417d7f5b443109eb892fc52fedde9, user_id=6fc4c21e2ae04b659f0bbc4ba3a02295, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:58.409604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:58.563194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1136/2315] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:58 2022] PUT /identity/v3/projects/dbb417d7f5b443109eb892fc52fedde9/users/6fc4c21e2ae04b659f0bbc4ba3a02295/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:58.574410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.574693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.575809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.607118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] MFA Rules not processed for user `6fc4c21e2ae04b659f0bbc4ba3a02295`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:58.608409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:58.692732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1180/2316] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:58.697614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.784482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679545b-5bff-4c8d-9e04-f54095878aea admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.792649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:58.793162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:58.794010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:58.794551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:58.797284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:58.801638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:58.905249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1137/2317] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:20:58 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:20:58.913359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.936405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551308-33c7-4525-b3c3-5bd978842a12 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:58.937834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:58.942731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:59.043487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.044498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.044947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.045442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.046267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.048623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.056253 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff660d-9245-4bca-afe8-5c4c9cb5f71c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:59.063282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.064150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.064459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.064728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] PATH_INFO: `/v3/projects/19c80e58a31245d09cac2fe74dbd7de6` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.066002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c80e58a31245d09cac2fe74dbd7de6)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.067942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.256638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1181/2318] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:20:58 2022] POST /identity/v3/users => generated 298 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:59.261099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:59.270646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c80e58a31245d09cac2fe74dbd7de6', 'request_id': 'req-02e77fb1-ece2-4293-a9ec-236d12540ff5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:59.271564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c9c8-3f96-48e3-b523-d7e9d7e58d4a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:59.330206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.330879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.331164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.331445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.332303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.333935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.344791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1182/2319] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:59.349185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:59.366359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb584f7-9e16-4edf-8b53-4eb77c878461 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:59.372412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.373463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.373747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.374021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] PATH_INFO: `/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe/users/7ec3798376f24017a03c30e48e41f7dd/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.393215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9ba22386c45e7bc022e0a9b8d8efe, user_id=7ec3798376f24017a03c30e48e41f7dd, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.396062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.546289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c80e58a31245d09cac2fe74dbd7de6', 'request_id': 'req-02e77fb1-ece2-4293-a9ec-236d12540ff5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:59.556397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c80e58a31245d09cac2fe74dbd7de6', 'request_id': 'req-02e77fb1-ece2-4293-a9ec-236d12540ff5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:59.557699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1183/2320] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:59 2022] PUT /identity/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe/users/7ec3798376f24017a03c30e48e41f7dd/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:20:59.561974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:59.581547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] The token cache is being invalidate because project 19c80e58a31245d09cac2fe74dbd7de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:59.581840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:59.584543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-02e77fb1-ece2-4293-a9ec-236d12540ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:59.588660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1138/2321] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:20:58 2022] DELETE /identity/v3/projects/19c80e58a31245d09cac2fe74dbd7de6 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:59.594139 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23655-f9ea-40fe-831e-35bcf19457ce None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.594514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23655-f9ea-40fe-831e-35bcf19457ce None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.594849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23655-f9ea-40fe-831e-35bcf19457ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.629045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a6f23655-f9ea-40fe-831e-35bcf19457ce None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:59.630702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a6f23655-f9ea-40fe-831e-35bcf19457ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:59.675891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f12155-c6cd-497c-b2bf-8fe3e959be7d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:59.683049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.683951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.684534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.685096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.686296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.688028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.703145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1184/2322] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:20:59.707601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:59.709593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:59.724188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1139/2323] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:59.732177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3b4de-71ca-416a-bdce-c565ae8a86ab admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:59.742926 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab67eb0-2dc3-41cf-bf10-bfa2a585d1b9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.743433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab67eb0-2dc3-41cf-bf10-bfa2a585d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.743945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab67eb0-2dc3-41cf-bf10-bfa2a585d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.747658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:59.748762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.749047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.749353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] PATH_INFO: `/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe/users/7ec3798376f24017a03c30e48e41f7dd/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.751352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9ba22386c45e7bc022e0a9b8d8efe, user_id=7ec3798376f24017a03c30e48e41f7dd, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:59.755427 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead1d35-8327-4e5b-846d-2c9ca8456044 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:59.782200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1185/2324] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:20:59 2022] PUT /identity/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe/users/7ec3798376f24017a03c30e48e41f7dd/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:59.789003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5ab67eb0-2dc3-41cf-bf10-bfa2a585d1b9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:59.789003 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5ab67eb0-2dc3-41cf-bf10-bfa2a585d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:59.793291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.796918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.797606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.858542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] MFA Rules not processed for user `7ec3798376f24017a03c30e48e41f7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:59.861303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:59.945195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1140/2325] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:20:59.948436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:59.948893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:59.949296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:59.971891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] MFA Rules not processed for user `2ed266f163ec4affa70580d2602d0720`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:59.973342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:00.027729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1186/2326] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:21:00.037187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.045383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:00.050406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5435ce-468b-4e51-a6a7-0c31002e1458 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.057105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.057812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.058095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.058368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.059091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:00.059389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.061692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.084523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1187/2327] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:00.084523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.085672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:00.089763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1141/2328] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:00.094487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.117329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3659-2c0d-42ec-82ea-0b36b47c647c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.127511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.128334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.128639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.128974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.129782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.134256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.203575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8434e-f50a-4d90-83ca-af351a6c65ed admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.207584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.208378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.208824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.209309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.219818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.221630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.234879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1188/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:00.264743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1142/2330] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:00 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:00.266709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.279098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d822a-6cc8-4788-8777-28d758ac4b0a service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.350849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.351528 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.351804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.352072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.361898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.361898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.420428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.486224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde40f0-b851-4087-a050-e5f5623dfc54 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.489934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.490587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.490873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.491145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.493750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:00.529487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1189/2331] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:00 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:00.531088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.543246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c032-a211-4c6e-812b-8a714741aeef admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.548542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.549531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.549752 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.550022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.550747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.552462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.569216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1190/2332] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:00.571467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.578702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.580584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.589870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7786-d770-4fdf-9fd2-f9e03cfdb8c2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.594860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.595721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.596020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.596337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.597102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.599627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1143/2333] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:00.609289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d9dca-bf72-46ee-a2f2-c8031af63b49 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.625517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1191/2334] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:00.630048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:00.644647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9732b7-0604-4beb-a25c-134d40de416d service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:00.654867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:00.656559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.657047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.657419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] PATH_INFO: `/v3/projects/1151f047be1a4a889576e535cbb43e5f/users/ffcb6658536849b08b6222740ec06366/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.680387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1151f047be1a4a889576e535cbb43e5f, user_id=ffcb6658536849b08b6222740ec06366, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:00.683319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:00.883492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1144/2335] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:00 2022] PUT /identity/v3/projects/1151f047be1a4a889576e535cbb43e5f/users/ffcb6658536849b08b6222740ec06366/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:00.900823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567139-9559-40e2-a727-91ad5861e54d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:00.901182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567139-9559-40e2-a727-91ad5861e54d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:00.901375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05567139-9559-40e2-a727-91ad5861e54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:00.942162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-05567139-9559-40e2-a727-91ad5861e54d None None] MFA Rules not processed for user `ffcb6658536849b08b6222740ec06366`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:00.948564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-05567139-9559-40e2-a727-91ad5861e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:01.044617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1192/2336] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:01.381981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:01.469300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0a64-4447-4e53-9539-0fc2d35eec73 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:01.474544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:01.475631 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:01.475936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:01.476236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] PATH_INFO: `/v3/users/6fc4c21e2ae04b659f0bbc4ba3a02295` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:01.477483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc4c21e2ae04b659f0bbc4ba3a02295)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:01.480398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:01.501950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:01.757773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc4c21e2ae04b659f0bbc4ba3a02295'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:01.775032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc4c21e2ae04b659f0bbc4ba3a02295'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:01.776303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc4c21e2ae04b659f0bbc4ba3a02295'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:01.777040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc4c21e2ae04b659f0bbc4ba3a02295'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:01.792437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc4c21e2ae04b659f0bbc4ba3a02295'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:01.960341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1145/2337] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:01 2022] DELETE /identity/v3/users/6fc4c21e2ae04b659f0bbc4ba3a02295 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:01.967914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:01.969283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:01.969766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:02.018103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:02.024589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:02.164694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1193/2338] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:02.181199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:02.182898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:02.255189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b5dd-5b5a-492c-a603-d1fc1260d7b9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:02.259143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:02.259812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:02.260099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:02.260525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:02.270823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:02.272366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:02.283506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1146/2339] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:02.830017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:02.831566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:02.835652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:02.856060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b12bc-9d8e-4523-8353-45074bbf5c14 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:02.866322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:02.867224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:02.868066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:02.868066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] PATH_INFO: `/v3/projects/dbb417d7f5b443109eb892fc52fedde9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:02.869552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb417d7f5b443109eb892fc52fedde9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:02.871474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:03.052693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb417d7f5b443109eb892fc52fedde9', 'request_id': 'req-ce1f7c0a-866e-453a-944a-e290ccdabfd4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.146693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb417d7f5b443109eb892fc52fedde9', 'request_id': 'req-ce1f7c0a-866e-453a-944a-e290ccdabfd4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.154386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb417d7f5b443109eb892fc52fedde9', 'request_id': 'req-ce1f7c0a-866e-453a-944a-e290ccdabfd4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.165727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] The token cache is being invalidate because project dbb417d7f5b443109eb892fc52fedde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:03.165923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.166676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.168228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1194/2340] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:02 2022] DELETE /identity/v3/projects/dbb417d7f5b443109eb892fc52fedde9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:03.172333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:03.182511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591cfa-bd9c-4731-af5c-1e24846d67e7 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:03.250789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:03.251800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:03.252109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:03.252414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] PATH_INFO: `/v3/users/7ec3798376f24017a03c30e48e41f7dd` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:03.253635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec3798376f24017a03c30e48e41f7dd)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:03.255845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:03.446947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec3798376f24017a03c30e48e41f7dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.460918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec3798376f24017a03c30e48e41f7dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.461563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec3798376f24017a03c30e48e41f7dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.462184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec3798376f24017a03c30e48e41f7dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.468862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f0f73b26-4e59-422a-8bd3-a3c6b9395142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec3798376f24017a03c30e48e41f7dd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:03.564482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1147/2341] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:03 2022] DELETE /identity/v3/users/7ec3798376f24017a03c30e48e41f7dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:03.781802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:04.058377 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:04.060226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:04.074501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f7c0a-866e-453a-944a-e290ccdabfd4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:04.135205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:04.136062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.136372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.136642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] PATH_INFO: `/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.138017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c9ba22386c45e7bc022e0a9b8d8efe)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:04.139888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:04.315409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c9ba22386c45e7bc022e0a9b8d8efe', 'request_id': 'req-8e970b78-7bcd-4f47-8b3f-8b79215533ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:04.478715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c9ba22386c45e7bc022e0a9b8d8efe', 'request_id': 'req-8e970b78-7bcd-4f47-8b3f-8b79215533ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:04.486374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c9ba22386c45e7bc022e0a9b8d8efe', 'request_id': 'req-8e970b78-7bcd-4f47-8b3f-8b79215533ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:04.501375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] The token cache is being invalidate because project c5c9ba22386c45e7bc022e0a9b8d8efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:04.501665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:04.502311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8e970b78-7bcd-4f47-8b3f-8b79215533ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:04.504077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1195/2342] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:04 2022] DELETE /identity/v3/projects/c5c9ba22386c45e7bc022e0a9b8d8efe => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:04.508997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.509535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.509535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.527836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:04.529067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:04.589204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1148/2343] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:04.597444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.597709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.597990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.617337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:04.618530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:04.626406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1196/2344] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:04.630792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:04.640709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4871a-6129-47e5-bbb1-f2a879144f6d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:04.645255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:04.645901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.647342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.647342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.647342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:04.647584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:04.649165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:04.660846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1149/2345] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:04.665603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:04.674830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fd8b2-257d-44b5-85c4-cd40587d3a48 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:04.680146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:04.680837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.681151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.681450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.682134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:04.684053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:04.730120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:04.800274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1197/2346] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:04.804717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:04.814988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba4e0-bb67-4f86-8667-8754c673857f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:04.874560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:04.875162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:04.875468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:04.875741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:04.876478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:04.878378 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:04.991719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1150/2347] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:04 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:04.995847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:05.006266 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a8a72-7d17-486a-b37b-60560d925fdc admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:05.010970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:05.011639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.011920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.012213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.013029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:05.014892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:05.026729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1198/2348] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:05.030548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:05.042793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6025-7616-4f6d-a5ed-7a97e2989c4e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:05.047676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:05.048381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.048662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.048933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.049655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:05.051254 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f57d-69d1-4f13-bec9-dffb36a4653f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:05.061662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1151/2349] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:05.065843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:05.076284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93bc3-31e9-4a41-abbf-92eeab250339 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:05.081438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:05.082342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.082624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.082898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] PATH_INFO: `/v3/projects/bca44e2e7452416d944fa539bb5928ed/users/dd9615830da84993ab0ad3a609bd7ce1/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.097702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca44e2e7452416d944fa539bb5928ed, user_id=dd9615830da84993ab0ad3a609bd7ce1, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:05.100438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:05.308362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1199/2350] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:05 2022] PUT /identity/v3/projects/bca44e2e7452416d944fa539bb5928ed/users/dd9615830da84993ab0ad3a609bd7ce1/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:05.313695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.314036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.314314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.345493 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] MFA Rules not processed for user `dd9615830da84993ab0ad3a609bd7ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:05.346701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:05.411362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1152/2351] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:05.423966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:05.425870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:05.510124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3459-88e0-4373-8c13-40731186d1f6 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:05.513861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:05.514511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.514792 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.515067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.524361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:05.525817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064d6e-cf46-402a-ada5-0dad2e801ee6 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:05.535540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1200/2352] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:05.555280 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:05.570567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:05.621364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db608fd-6a25-44ed-92cf-f1d749459494 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:05.626818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:05.627783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:05.628120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:05.628438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] PATH_INFO: `/v3/users/dd9615830da84993ab0ad3a609bd7ce1` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:05.629678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9615830da84993ab0ad3a609bd7ce1)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:05.632932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:05.950189 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9615830da84993ab0ad3a609bd7ce1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:05.963817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9615830da84993ab0ad3a609bd7ce1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:05.964581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9615830da84993ab0ad3a609bd7ce1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:05.965181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9615830da84993ab0ad3a609bd7ce1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:05.972213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9615830da84993ab0ad3a609bd7ce1'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:06.135942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1153/2353] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:05 2022] DELETE /identity/v3/users/dd9615830da84993ab0ad3a609bd7ce1 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:06.140549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:06.141071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:06.141181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:06.159376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:06.160609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:06.226387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1201/2354] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:06.236157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:06.237731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:06.301594 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ced093-3023-42ac-95e6-00469554f4fa admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:06.305345 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:06.305989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:06.306803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:06.306803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:06.316896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:06.318488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:06.331516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1154/2355] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:06.337211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:06.755123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:06.757821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:06.776174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:06.778315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:06.801029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57509a-5fb8-428a-8d04-d45ad5d65848 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:06.805712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:06.806600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:06.806886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:06.807136 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] PATH_INFO: `/v3/projects/bca44e2e7452416d944fa539bb5928ed` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:06.808841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca44e2e7452416d944fa539bb5928ed)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:06.810761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:06.869490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb88c-fa8e-462c-befc-e88c0495d322 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:06.873139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:06.873779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:06.874053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:06.874322 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:06.876102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:06.950977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:06.952688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835937a-9018-41ff-9d16-192e81d688e0 service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:06.953173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca44e2e7452416d944fa539bb5928ed', 'request_id': 'req-e89e6879-a0db-4faf-9b8c-936c887956ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:06.964697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1202/2356] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:07.078195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca44e2e7452416d944fa539bb5928ed', 'request_id': 'req-e89e6879-a0db-4faf-9b8c-936c887956ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:07.089158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca44e2e7452416d944fa539bb5928ed', 'request_id': 'req-e89e6879-a0db-4faf-9b8c-936c887956ac'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:07.104991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] The token cache is being invalidate because project bca44e2e7452416d944fa539bb5928ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:07.110620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:07.110620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e89e6879-a0db-4faf-9b8c-936c887956ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:07.110620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1155/2357] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:06 2022] DELETE /identity/v3/projects/bca44e2e7452416d944fa539bb5928ed => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:07.114915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705133c-ee97-4897-80dd-996480fcc390 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.117259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705133c-ee97-4897-80dd-996480fcc390 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.117636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705133c-ee97-4897-80dd-996480fcc390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.140189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-b705133c-ee97-4897-80dd-996480fcc390 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:07.141784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b705133c-ee97-4897-80dd-996480fcc390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:07.236831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1203/2358] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:07.240641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87875-f2ad-4e53-b28f-75ff404e2911 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.242092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87875-f2ad-4e53-b28f-75ff404e2911 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.242534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87875-f2ad-4e53-b28f-75ff404e2911 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.244497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1156/2359] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 19 12:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:21:07.245708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.246800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.246800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.250597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.250965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.251568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.267736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:07.269206 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:07.279281 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1204/2360] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:07.285675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.293637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:07.294843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:07.297036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df177ca-cc64-457f-b700-b45ffb4974e5 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.302196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:07.305504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.309903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.309903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.309903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.309903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:07.309903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.311874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.323861 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1205/2361] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:07.328545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.339464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea59b-340b-4c78-8d2e-019e190ba1d7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.344839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.345373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.354079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.354079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.354079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.354079 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.354694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1157/2362] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:21:07.365526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.367839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:07.378467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf4f11-9173-4263-a742-ced3d446c717 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.382940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.383576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.383851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.384369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.393117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.394573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.403208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1158/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:07.465099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1206/2364] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:07.469649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.483664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb0d54-fdfe-4ca7-8640-c202f9633433 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.544437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.544974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.545084 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.545330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.546053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.547988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.725096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1159/2365] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:07.730177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.740910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e21cb-da32-4853-ab9a-9d55ff3d20a0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.746074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.746728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.747010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.747282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.747998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.749623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.759558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1207/2366] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:07.763647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.774249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8dc1c-12f6-477b-b03c-af1c8fd2fc76 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.779569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.780329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.781114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.781114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.781851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.783708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45866ecd-a9bd-495a-b442-d9f81bb73e55 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.799332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1160/2367] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:07.800543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:07.811175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6846a2-fccb-4297-adb8-a98944dfdd00 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:07.821007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:07.821007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.821007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.821007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] PATH_INFO: `/v3/projects/7864b6fa3d66423291787575d10c7e58/users/7d6e92bff47f4480b38a27b919714bc1/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:07.834670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7864b6fa3d66423291787575d10c7e58, user_id=7d6e92bff47f4480b38a27b919714bc1, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:07.837911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:07.965130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1208/2368] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:07 2022] PUT /identity/v3/projects/7864b6fa3d66423291787575d10c7e58/users/7d6e92bff47f4480b38a27b919714bc1/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:07.998210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:07.998516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:07.998750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.033761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] MFA Rules not processed for user `7d6e92bff47f4480b38a27b919714bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:08.033761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:08.113581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1161/2369] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:08.117896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:08.196344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ca8c-1652-4545-8856-f3f10b26ea0e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:08.201138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:08.201795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:08.202096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:08.202393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.203363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:08.205580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:08.392540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1209/2370] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:08 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:08.396614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:08.409555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b578-3549-41e3-bf17-835a1eae0b1b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:08.479387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:08.480525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:08.481213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:08.481491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.482187 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:08.484494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:08.486880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:08.735066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1162/2371] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:08 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:08.737797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:08.749518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735da9-fa39-45f0-a0c9-5064a97087bf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:08.754243 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:08.754904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:08.755188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:08.756036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.756169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:08.757833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:08.773057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1210/2372] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:08.778787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:08.790571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeab3b-3b4a-4fe4-bfd8-d36761a6d47a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:08.795722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:08.796426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:08.796748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:08.797068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.797793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:08.799474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfa28b-53f6-41d3-887e-812ec43c847e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:08.809884 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1163/2373] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:08.814339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:08.824889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191565-6411-438c-93a4-cc2f0f957acf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:08.830103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:08.831031 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:08.831306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:08.831571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] PATH_INFO: `/v3/projects/e41f995512824e8aa262652d281e9824/users/2b767a7101de48949b2885191536ae46/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:08.847222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41f995512824e8aa262652d281e9824, user_id=2b767a7101de48949b2885191536ae46, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:08.850054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:09.165145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1211/2374] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:08 2022] PUT /identity/v3/projects/e41f995512824e8aa262652d281e9824/users/2b767a7101de48949b2885191536ae46/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:09.175284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.175579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.175861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.209023 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] MFA Rules not processed for user `2b767a7101de48949b2885191536ae46`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:09.210048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:09.332030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1164/2375] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:09.338961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:09.419892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202078-dcb6-4b53-8506-476ba021a876 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:09.424717 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:09.425392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.425777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.425946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.426644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:09.428847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:09.596905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1212/2376] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:09 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:09.601879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:09.607283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:09.609016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:09.614823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cb7f-58bc-4a43-bf3e-f89763434032 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:09.690775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:09.691943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.692431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92f46-22a4-47c2-88e5-7bb65388d126 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:09.692551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.692840 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.693621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:09.696726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:09.698886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:09.699896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.700287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.700634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] PATH_INFO: `/v3/users/6d1b977fe42941c2a99a7884d3318104` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.701925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1b977fe42941c2a99a7884d3318104)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:09.704150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:09.880651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1165/2377] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:09 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:09.885508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:09.900797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7554-7b6a-43e9-83fa-41e2fd30b735 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:09.908907 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:09.920952 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.921237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.921517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.922278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:09.923964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:09.939527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1166/2378] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:09.942876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:09.956335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5031fd-36a3-440d-8bfa-91190056878e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:09.961616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:09.962554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:09.962827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:09.963094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] PATH_INFO: `/v3/projects/e26edadb2404487689c503975d7ae13c/users/e9e9e5dd1c824743a8d9cbf902f9fb19/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:09.979400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26edadb2404487689c503975d7ae13c, user_id=e9e9e5dd1c824743a8d9cbf902f9fb19, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:09.985598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:10.066526 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1b977fe42941c2a99a7884d3318104'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:10.081070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1b977fe42941c2a99a7884d3318104'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:10.087842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1b977fe42941c2a99a7884d3318104'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:10.088845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1b977fe42941c2a99a7884d3318104'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:10.089338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8518c4e5-4c43-4dd3-8b47-dcc689dc9c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1b977fe42941c2a99a7884d3318104'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:10.095254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:10.102096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1167/2379] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:09 2022] PUT /identity/v3/projects/e26edadb2404487689c503975d7ae13c/users/e9e9e5dd1c824743a8d9cbf902f9fb19/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:10.104032 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:10.105896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.173179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c2a1-3734-4cde-8562-ac226ebfe2c7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:10.177858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:10.178546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.179350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.179626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.180651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:10.191580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:10.192893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1168/2380] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:10.197809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:10.207724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700c84-082e-4c08-8b95-f07280aaf9cc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:10.213055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:10.213922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.214203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.214480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] PATH_INFO: `/v3/projects/e26edadb2404487689c503975d7ae13c/users/e9e9e5dd1c824743a8d9cbf902f9fb19/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.216471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26edadb2404487689c503975d7ae13c, user_id=e9e9e5dd1c824743a8d9cbf902f9fb19, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:10.219297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de127-950e-441d-8f19-dddfd2a60cb0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:10.231862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1169/2381] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:10 2022] PUT /identity/v3/projects/e26edadb2404487689c503975d7ae13c/users/e9e9e5dd1c824743a8d9cbf902f9fb19/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:10.237489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1213/2382] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:09 2022] DELETE /identity/v3/users/6d1b977fe42941c2a99a7884d3318104 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:10.240636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.241054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.241885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.248809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.249098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.249777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.266597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:10.268141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.300154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] MFA Rules not processed for user `e9e9e5dd1c824743a8d9cbf902f9fb19`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:10.301772 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.346426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1170/2383] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:10.356158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:10.359790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.407491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1214/2384] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:21:10.409041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:10.410574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.422872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0b8c-7c17-4d81-9aa8-eddac783b0a0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:10.426464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:10.427106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.427384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.427657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.442801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:10.444886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:10.457375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1171/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:10.495363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd63fa4-2cf6-4d92-9d87-092a9b59511f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:10.500459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:10.501232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:10.501614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:10.501965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:10.504762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:10.580757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:10.582318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef426b4-a4db-4ead-b444-db27a1a507e4 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:10.595366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1215/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:11.003155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:11.003659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:11.017208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaff13-22e6-4446-8305-a3236d83dc89 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:11.022276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:11.023168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.023469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.026947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] PATH_INFO: `/v3/projects/87d93fa8d09d478a9993a271ff089ae7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.028221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d93fa8d09d478a9993a271ff089ae7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:11.030239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:11.201981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d93fa8d09d478a9993a271ff089ae7', 'request_id': 'req-9657c449-e15d-4131-b293-829d44e88e47'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:11.239211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:11.312838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d93fa8d09d478a9993a271ff089ae7', 'request_id': 'req-9657c449-e15d-4131-b293-829d44e88e47'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:11.320070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d93fa8d09d478a9993a271ff089ae7', 'request_id': 'req-9657c449-e15d-4131-b293-829d44e88e47'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:11.340049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] The token cache is being invalidate because project 87d93fa8d09d478a9993a271ff089ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:11.340049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:11.340049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9657c449-e15d-4131-b293-829d44e88e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:11.340049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1172/2387] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:11 2022] DELETE /identity/v3/projects/87d93fa8d09d478a9993a271ff089ae7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:11.344918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.345336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.348321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.404096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:11.405623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:11.451658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:11.493232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1216/2388] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:11.500732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.501094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.501437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.521421 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:11.523259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:11.531966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1173/2389] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:11.536059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:11.547148 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdcd8-9cf1-4bc3-bf5d-cde037c1799b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:11.552510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:11.552708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.552990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.553255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.554185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:11.554484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:11.556590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:11.573108 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1217/2390] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:11.577411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:11.592275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd1748-f10e-4870-b495-2ad341521e85 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:11.598556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:11.599291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.599490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.599761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.600977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:11.603617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:11.786673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1174/2391] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:11 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:11.791713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:11.805817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9d3cf-c79e-4bda-bdd5-772e6a131a28 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:11.866462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:11.867058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:11.867349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:11.867620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:11.868341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:11.870352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:12.048937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1218/2392] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:11 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:12.053054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:12.063525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecd453-3d00-4dae-b353-3ccc7f590431 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:12.068207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:12.068935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:12.069221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:12.070146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:12.070808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:12.072582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:12.083668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1175/2393] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:12.088695 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:12.098692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15690201-1d1f-414e-9954-178236e14b7a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:12.103255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:12.103906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:12.104188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:12.104497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:12.105207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:12.106829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42b4b5-9ec0-4420-91ea-9d0a0b7e4deb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:12.116900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1219/2394] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:12.120935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:12.134845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d648e-f621-45da-a0a4-a7f78e0293bd admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:12.138893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:12.139860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:12.140143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:12.140453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] PATH_INFO: `/v3/projects/8fdc465469f74948a1b47a893e022649/users/8efc2840d636424199237404b700700f/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:12.158227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdc465469f74948a1b47a893e022649, user_id=8efc2840d636424199237404b700700f, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:12.161251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:12.302330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1176/2395] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:12 2022] PUT /identity/v3/projects/8fdc465469f74948a1b47a893e022649/users/8efc2840d636424199237404b700700f/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:12.313018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:12.313341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:12.313619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:12.344414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] MFA Rules not processed for user `8efc2840d636424199237404b700700f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:12.345681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:12.414934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1220/2396] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:12.428432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:12.432817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:12.530339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cf6d-0f1d-4bde-b79c-61363dec3651 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:12.535405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:12.536116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:12.539091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:12.539091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:12.546699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:12.548237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:12.560371 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1177/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:13.138886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:13.140300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:13.152582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e8e9-9a1f-46c5-bc26-841514aa31db None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:13.156273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:13.156906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:13.157184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:13.157509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:13.159192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:13.220233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:13.224441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:13.231004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1221/2398] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:14.743478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:14.844562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:15.408792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:15.419397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade81511-7ba1-477e-8b9b-c9f38ec65cc2 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:15.423069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:15.423702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:15.424011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:15.424313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:15.426130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:15.493198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:15.494656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4653b2-3f8e-44e6-ad91-41b5069ad169 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:15.504821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1178/2399] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:17.259983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:17.315416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:20.996155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:20.997629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:21.087249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6344-1cd1-46b8-b4f4-8a7e0b166afe service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:21.092689 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:21.093676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:21.094852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:21.094852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] PATH_INFO: `/v3/users/7d6e92bff47f4480b38a27b919714bc1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:21.095653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6e92bff47f4480b38a27b919714bc1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:21.097653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:21.211974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:21.277375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:21.392753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6e92bff47f4480b38a27b919714bc1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:21.412664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6e92bff47f4480b38a27b919714bc1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:21.424431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6e92bff47f4480b38a27b919714bc1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:21.425589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6e92bff47f4480b38a27b919714bc1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:21.426363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6e92bff47f4480b38a27b919714bc1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:21.515569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1222/2400] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:20 2022] DELETE /identity/v3/users/7d6e92bff47f4480b38a27b919714bc1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:21.519919 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:21.520337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:21.520614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:21.541918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:21.543150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:21.648989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1179/2401] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:21.669366 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:21.671460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:21.738805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741addae-a99b-4e07-b7cf-8e7460c39f73 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:21.747723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:21.747723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:21.747723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:21.747723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:21.755790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:21.757380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:21.767799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1223/2402] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:22.302888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:22.305239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:22.320248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76cf3f-73cb-4136-880e-a660b0b47ad2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:22.327419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:22.327419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:22.327419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:22.327419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] PATH_INFO: `/v3/projects/7864b6fa3d66423291787575d10c7e58` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:22.330520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7864b6fa3d66423291787575d10c7e58)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:22.332705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:22.537831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7864b6fa3d66423291787575d10c7e58', 'request_id': 'req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:22.647150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7864b6fa3d66423291787575d10c7e58', 'request_id': 'req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:22.647150 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7864b6fa3d66423291787575d10c7e58', 'request_id': 'req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:22.659640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] The token cache is being invalidate because project 7864b6fa3d66423291787575d10c7e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:22.659937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:22.660806 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:22.662641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1180/2403] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:22 2022] DELETE /identity/v3/projects/7864b6fa3d66423291787575d10c7e58 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:22.666766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:22.677350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba387631-2f97-483e-9e63-cb178f8d9bf1 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:22.753344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:22.754254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:22.754535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:22.754808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] PATH_INFO: `/v3/users/2b767a7101de48949b2885191536ae46` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:22.756017 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b767a7101de48949b2885191536ae46)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:22.759353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:23.100638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b767a7101de48949b2885191536ae46'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:23.114477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b767a7101de48949b2885191536ae46'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:23.126335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b767a7101de48949b2885191536ae46'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:23.127155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b767a7101de48949b2885191536ae46'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:23.127774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b767a7101de48949b2885191536ae46'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:23.271738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1224/2404] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:22 2022] DELETE /identity/v3/users/2b767a7101de48949b2885191536ae46 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:23.570683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:23.904111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:23.905834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:23.925945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff6d6-a5e5-4814-9b06-f61eb16e1564 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:23.986356 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:23.987220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:23.987527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:23.987799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] PATH_INFO: `/v3/projects/e41f995512824e8aa262652d281e9824` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:23.989020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41f995512824e8aa262652d281e9824)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:23.990999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:24.123901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41f995512824e8aa262652d281e9824', 'request_id': 'req-93632e56-ab10-49f8-8973-c0bbd8ecf06e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.244614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41f995512824e8aa262652d281e9824', 'request_id': 'req-93632e56-ab10-49f8-8973-c0bbd8ecf06e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.254396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41f995512824e8aa262652d281e9824', 'request_id': 'req-93632e56-ab10-49f8-8973-c0bbd8ecf06e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.267224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] The token cache is being invalidate because project e41f995512824e8aa262652d281e9824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:24.267674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.268611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.270492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1181/2405] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:23 2022] DELETE /identity/v3/projects/e41f995512824e8aa262652d281e9824 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:24.276176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:24.277743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:24.291075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30826-8eb2-4297-8ccb-fbad6f54d7d7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:24.353547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:24.354434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:24.354707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:24.354974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] PATH_INFO: `/v3/users/e9e9e5dd1c824743a8d9cbf902f9fb19` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:24.356144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e9e5dd1c824743a8d9cbf902f9fb19)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:24.358127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:24.648509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e9e5dd1c824743a8d9cbf902f9fb19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.660607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e9e5dd1c824743a8d9cbf902f9fb19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.661551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:24.663479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:24.668510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e9e5dd1c824743a8d9cbf902f9fb19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.669194 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e9e5dd1c824743a8d9cbf902f9fb19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.669890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e029490c-1ae4-42de-93ab-bbee1a760026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e9e5dd1c824743a8d9cbf902f9fb19'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:24.674239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:24.678279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632e56-ab10-49f8-8973-c0bbd8ecf06e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:24.684220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:24.685169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:24.685439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:24.685720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] PATH_INFO: `/v3/users/dda91c77f7984cc2ac41268fe15b0c94` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:24.687000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda91c77f7984cc2ac41268fe15b0c94)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:24.689133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:24.779372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1225/2406] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:24 2022] DELETE /identity/v3/users/e9e9e5dd1c824743a8d9cbf902f9fb19 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:25.016180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda91c77f7984cc2ac41268fe15b0c94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.030618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda91c77f7984cc2ac41268fe15b0c94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.031400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda91c77f7984cc2ac41268fe15b0c94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.032282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda91c77f7984cc2ac41268fe15b0c94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.040245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda91c77f7984cc2ac41268fe15b0c94'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.186204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1182/2407] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:24 2022] DELETE /identity/v3/users/dda91c77f7984cc2ac41268fe15b0c94 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:25.190708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:25.191000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:25.191524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:25.222648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:25.229801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:25.333531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1226/2408] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:25.349565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:25.349565 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:25.419357 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92538d5e-c359-44c2-a361-0d378a809343 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:25.423306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:25.424011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:25.424319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:25.424595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:25.442605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:25.445744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:25.465393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1183/2409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:25.481981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:25.483656 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:25.502630 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce63c-7ab9-453c-a235-814469c0c4a2 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:25.511805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:25.512730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:25.516595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:25.516595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] PATH_INFO: `/v3/projects/e26edadb2404487689c503975d7ae13c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:25.516595 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26edadb2404487689c503975d7ae13c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:25.517569 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:25.676718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26edadb2404487689c503975d7ae13c', 'request_id': 'req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.753558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26edadb2404487689c503975d7ae13c', 'request_id': 'req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.762870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26edadb2404487689c503975d7ae13c', 'request_id': 'req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.773915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] The token cache is being invalidate because project e26edadb2404487689c503975d7ae13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:25.774123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.774867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b6155f0f-cc47-4e4e-9bd5-3d4d7a3b5a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:25.788362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1227/2410] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:25 2022] DELETE /identity/v3/projects/e26edadb2404487689c503975d7ae13c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:25.788362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:25.970525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:25.971979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:25.987415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775938-8fd7-4c02-8ff8-a48d76ddcccd service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.044709 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.045488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.045768 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.046039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] PATH_INFO: `/v3/projects/565090ed2d3d41258a4d703c31100bf8` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.047335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565090ed2d3d41258a4d703c31100bf8)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.049445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.204188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565090ed2d3d41258a4d703c31100bf8', 'request_id': 'req-6e2192d8-24d9-439f-8a96-52d6284ce122'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:26.300289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565090ed2d3d41258a4d703c31100bf8', 'request_id': 'req-6e2192d8-24d9-439f-8a96-52d6284ce122'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:26.309808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565090ed2d3d41258a4d703c31100bf8', 'request_id': 'req-6e2192d8-24d9-439f-8a96-52d6284ce122'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:26.323720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] The token cache is being invalidate because project 565090ed2d3d41258a4d703c31100bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:26.324010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:26.324711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-6e2192d8-24d9-439f-8a96-52d6284ce122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:26.326289 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1184/2411] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:25 2022] DELETE /identity/v3/projects/565090ed2d3d41258a4d703c31100bf8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:26.332991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.333285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.333568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.353440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:26.354644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:26.414192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1228/2412] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:26.422124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.422416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.422698 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.441821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:26.443025 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:26.451644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1185/2413] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:26.456318 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.466554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156f2b-3958-497a-bbfa-eaaf782450ac None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.471452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.472145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.472475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.472757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.473546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:26.473996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.475706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.488813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1229/2414] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:26.496035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.505705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b33a06-7818-42b4-871d-1c94a01ff423 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.511234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.511944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.512249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.512530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.513276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.515246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.651701 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1186/2415] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:26 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:26.655919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.665773 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845674a-699c-4b28-b543-b561013d98fe admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.724809 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.725504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.725786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.726060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.726747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.728819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.907681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1230/2416] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:26 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:26.911882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.922864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb487e-34e7-45f3-b217-dfc404a2bc20 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.927610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.928530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.929382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.929649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.930373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.932426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.950473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1187/2417] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:26.950709 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.960288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6ba1-5dbb-485a-94d5-e26515796d33 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.965107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:26.965767 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:26.966047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:26.966320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:26.967032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:26.968650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e54a9-6ca4-4365-8de0-a42213e13803 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:26.979921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1231/2418] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:26.984467 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:26.995103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf01f-df59-43e0-9e95-0932d86b3f6a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:26.999503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:27.000431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:27.000743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:27.001014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] PATH_INFO: `/v3/projects/f936dcd96a554a6fa2ba5147eaf4b117/users/7f1be00a0a774a9e97c55338b7fa710b/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:27.015533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f936dcd96a554a6fa2ba5147eaf4b117, user_id=7f1be00a0a774a9e97c55338b7fa710b, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:27.018215 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:27.165736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1188/2419] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:26 2022] PUT /identity/v3/projects/f936dcd96a554a6fa2ba5147eaf4b117/users/7f1be00a0a774a9e97c55338b7fa710b/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:27.173509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:27.173509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:27.173509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:27.195381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:27.196650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:27.266370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1232/2420] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:27.276843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:27.278792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:27.314521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:27.315818 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:27.329305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6c31-7345-4e7b-802f-0af5009e9d49 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:27.342638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:27.343452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:27.343730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:27.344000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] PATH_INFO: `/v3/users/8efc2840d636424199237404b700700f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:27.345843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efc2840d636424199237404b700700f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:27.348839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:27.378812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6ff0-557c-49f5-b951-1aaf6e63bc1b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:27.383331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:27.383974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:27.384286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:27.384791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:27.394882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:27.396411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b90b3-e652-4ef6-bc41-92f983eba4c3 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:27.408293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1189/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:27.776932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efc2840d636424199237404b700700f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:27.795223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efc2840d636424199237404b700700f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:27.802754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efc2840d636424199237404b700700f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:27.808315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efc2840d636424199237404b700700f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:27.808315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efc2840d636424199237404b700700f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:27.909561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1233/2422] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:27 2022] DELETE /identity/v3/users/8efc2840d636424199237404b700700f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:27.913229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:27.913515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:27.913792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:27.940093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:27.941468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:28.006504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1190/2423] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:28.023288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:28.025098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:28.086898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f668de-a926-4fec-ba52-4595de5e696f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:28.090687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:28.091480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:28.091764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:28.092052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:28.101599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:28.104688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461b11d-c46c-403c-b380-dc5b2b11d2e9 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:28.115545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1234/2424] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:28.195165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:28.306995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:28.805953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:28.807419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:28.819188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b3b3-9311-40ac-b64a-9f2cbba77e71 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:28.823887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:28.824836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:28.825277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:28.829719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] PATH_INFO: `/v3/projects/8fdc465469f74948a1b47a893e022649` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:28.829719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdc465469f74948a1b47a893e022649)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:28.829719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:28.953794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdc465469f74948a1b47a893e022649', 'request_id': 'req-f83ae74e-b875-4a35-b473-a32c72d62c1f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:29.033244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdc465469f74948a1b47a893e022649', 'request_id': 'req-f83ae74e-b875-4a35-b473-a32c72d62c1f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:29.041996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdc465469f74948a1b47a893e022649', 'request_id': 'req-f83ae74e-b875-4a35-b473-a32c72d62c1f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:29.056475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] The token cache is being invalidate because project 8fdc465469f74948a1b47a893e022649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:29.057464 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:29.058292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:29.061173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1191/2425] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:28 2022] DELETE /identity/v3/projects/8fdc465469f74948a1b47a893e022649 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:31.071073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803a158-abe5-4b0d-a5e0-e6f5fe6cb62c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:31.084678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803a158-abe5-4b0d-a5e0-e6f5fe6cb62c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:31.084678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803a158-abe5-4b0d-a5e0-e6f5fe6cb62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:31.091074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f803a158-abe5-4b0d-a5e0-e6f5fe6cb62c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:31.092351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f803a158-abe5-4b0d-a5e0-e6f5fe6cb62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:31.162162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1235/2426] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:31.186798 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:31.188745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:31.319738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae74e-b875-4a35-b473-a32c72d62c1f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:31.331250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:31.332808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:31.333270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:31.333555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:31.349458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:31.352349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:31.371737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1192/2427] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:32.004858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:32.084763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:33.930140 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:33.936388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:33.936739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:33.937254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:33.970116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] MFA Rules not processed for user `7f1be00a0a774a9e97c55338b7fa710b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:33.971365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:34.050669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1236/2428] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:34.056194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.059263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:34.077597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c59a61-e6a0-4415-b2cb-3e32555fe596 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.083317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.084306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.084821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.085608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.086722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.089095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.187275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1193/2429] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:34 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:34.191166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.208558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d552-7daa-4619-aedc-604d034c329a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.286906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.287620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.288552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.288790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.289513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.291450 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.428238 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1237/2430] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:34 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:34.432342 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.442753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b568c9-eefc-4d54-abb6-59c761afa396 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.449377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.450074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.450359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.450635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.451361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.453060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.464392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1194/2431] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:34.476653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.486594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64cec-8423-47b6-95d5-b471f935541d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.491853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.493023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.493300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.493573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] PATH_INFO: `/v3/projects/248901b0f2e140028557db310157c4e9/users/1f48d680f0614ad792aeb5dedaac55e3/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.508479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248901b0f2e140028557db310157c4e9, user_id=1f48d680f0614ad792aeb5dedaac55e3, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.511109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.627867 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1238/2432] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:34 2022] PUT /identity/v3/projects/248901b0f2e140028557db310157c4e9/users/1f48d680f0614ad792aeb5dedaac55e3/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:34.632158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.634931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:34.644516 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66560f9-1a9d-4576-b7da-944939fb0102 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.702419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.703012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.703294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.703568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.704312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.706335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc70f94-db9d-4811-a0ab-ec8ee3c97830 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.717573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1195/2433] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:34.721986 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.732890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21b1f-71eb-4dd9-b024-2dda96645bb7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.737641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.738560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.738838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.739112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] PATH_INFO: `/v3/projects/248901b0f2e140028557db310157c4e9/users/1f48d680f0614ad792aeb5dedaac55e3/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.741682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248901b0f2e140028557db310157c4e9, user_id=1f48d680f0614ad792aeb5dedaac55e3, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.745513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.755816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1239/2434] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:34 2022] PUT /identity/v3/projects/248901b0f2e140028557db310157c4e9/users/1f48d680f0614ad792aeb5dedaac55e3/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:35.771090 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:36.918785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:37.581353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63817e2-e70a-4fa1-a118-f26408c00204 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.582247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63817e2-e70a-4fa1-a118-f26408c00204 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.582595 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63817e2-e70a-4fa1-a118-f26408c00204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.603695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b63817e2-e70a-4fa1-a118-f26408c00204 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:37.605094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b63817e2-e70a-4fa1-a118-f26408c00204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:37.692284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1196/2435] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:37.714442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.818125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0436ad-0f7a-4d8a-9a56-73304587bac5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.837277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.837277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.837277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.837277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.840894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.843164 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.859292 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1240/2436] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:38.450606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:40.947785 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=13,keystone:SELECT=82,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:41.784026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b170-6e99-4b3f-a5a6-31c8e0098547 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.784657 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b170-6e99-4b3f-a5a6-31c8e0098547 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.784748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b170-6e99-4b3f-a5a6-31c8e0098547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.854587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cc44b170-6e99-4b3f-a5a6-31c8e0098547 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:41.857823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:41.859269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cc44b170-6e99-4b3f-a5a6-31c8e0098547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.963424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1197/2437] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:42.015984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.020381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.132068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd42ee-c8ef-4750-a964-70e4323b211b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.134914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd42ee-c8ef-4750-a964-70e4323b211b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.134914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd42ee-c8ef-4750-a964-70e4323b211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.167315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88d45-d1d3-4e57-9ad1-135045b8dd7c service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.176574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.177501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.177933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.179198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-40fd42ee-c8ef-4750-a964-70e4323b211b None None] MFA Rules not processed for user `1f48d680f0614ad792aeb5dedaac55e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:42.179333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.180817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40fd42ee-c8ef-4750-a964-70e4323b211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.195392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.198617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.215647 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1241/2438] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:21:42.315659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1198/2439] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:42.323978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.331879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.449955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54663d-63c4-457f-a712-64d4fea6b41b service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.454298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.454959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.458068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.458068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.529779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.531183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.544881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1242/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:42.903160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f084-212b-4396-871a-83c39fee2676 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.903644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f084-212b-4396-871a-83c39fee2676 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.903800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f084-212b-4396-871a-83c39fee2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.931900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6695f084-212b-4396-871a-83c39fee2676 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:42.935193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6695f084-212b-4396-871a-83c39fee2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.979549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1199/2441] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:43.025905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:43.047946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2c726-2ee7-4a29-a79a-d19e53acc97f service glance] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:43.075547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:43.077578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:43.077578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:43.077578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:43.105873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:43.110748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:43.128622 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1243/2442] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:21:43.435223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:43.435786 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:43.436073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:43.477119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:43.484635 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:43.489555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1200/2443] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:43.515661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:43.529920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:43.583574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037504-493b-4b2b-acd4-30b2eac30ae2 service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:43.596025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:43.597320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:43.597790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:43.598222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:43.608950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:43.610994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa1640-9272-4984-a493-2f2ebe444277 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:43.647100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1244/2444] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:44.067143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:44.068605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:44.089374 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ebfc8-72a2-4e41-ac50-22a135778e8d None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:44.098649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:44.099837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:44.100842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:44.101288 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] PATH_INFO: `/v3/users/ffcb6658536849b08b6222740ec06366` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:44.103474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcb6658536849b08b6222740ec06366)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:44.107440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:44.165170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:44.237572 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:44.445982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcb6658536849b08b6222740ec06366'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:44.470716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcb6658536849b08b6222740ec06366'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:44.474828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcb6658536849b08b6222740ec06366'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:44.491175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcb6658536849b08b6222740ec06366'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:44.512141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcb6658536849b08b6222740ec06366'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:44.618432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1201/2445] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:44 2022] DELETE /identity/v3/users/ffcb6658536849b08b6222740ec06366 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:44.623979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:44.624446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:44.624571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:44.662523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:44.663897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:44.859381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1245/2446] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:44.868071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:44.873015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:45.060910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d385f2-69c1-46a7-afe4-9e7d201d8eba admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:45.066105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:45.067037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:45.067416 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:45.068001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:45.081329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:45.084826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bcdfd-f0c1-49e0-a37e-2ab7623ef0b7 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:45.100358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1202/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:45.454870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:46.048820 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:46.170059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:46.171608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:46.247090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a579f1-6e23-4413-b3ed-24490011f933 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:46.257995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:46.258870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.259146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.259412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] PATH_INFO: `/v3/projects/1151f047be1a4a889576e535cbb43e5f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.295444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1151f047be1a4a889576e535cbb43e5f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:46.295444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:46.609334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1151f047be1a4a889576e535cbb43e5f', 'request_id': 'req-6b21f277-229f-4c07-9687-2aeefd57e7b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.690008 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1151f047be1a4a889576e535cbb43e5f', 'request_id': 'req-6b21f277-229f-4c07-9687-2aeefd57e7b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.701578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1151f047be1a4a889576e535cbb43e5f', 'request_id': 'req-6b21f277-229f-4c07-9687-2aeefd57e7b5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.736777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] The token cache is being invalidate because project 1151f047be1a4a889576e535cbb43e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:46.737068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.739669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-6b21f277-229f-4c07-9687-2aeefd57e7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.743418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1246/2448] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:46 2022] DELETE /identity/v3/projects/1151f047be1a4a889576e535cbb43e5f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:46.748538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.749098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.749278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.788910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:46.794956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:46.952581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1203/2449] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:46.962510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.969978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.970945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.996962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:47.004350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:47.014756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1247/2450] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:47.019480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.034939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bada146-c581-4e48-b702-168ac1436fc1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.040483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.041766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.041766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.042105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.043005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:47.043572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.045930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.070175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.077385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1204/2451] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:47.087542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61a99-470c-4f41-aa3a-14cd6c32bd44 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.095975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.096983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.097504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.097936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.099245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.102074 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.272912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1248/2452] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:47.278653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.323337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53065cc-9872-4668-b2a9-139babb9cac6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.454713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.455404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.455975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.456271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.457035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.459133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.580386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1205/2453] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:47.598504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.619440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558495c9-fb6a-40cb-ab96-8cf993606ad2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.638229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.639973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.641036 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.641580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.644127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.646920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.664940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1249/2454] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:47.672980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.695990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:47.733471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee83a-20ae-439f-accb-86a81f5fbeb3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.793968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.795441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.795888 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.796376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.797310 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.799159 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b0441-309c-4d62-8809-6101c81103ef admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.822461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1206/2455] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:47.854925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.876856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303bad-2c2c-4433-add1-c53a0719adff admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.888616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.889566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.889850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.890129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] PATH_INFO: `/v3/projects/dfc29cd87d4644b9be5f11728032dd2f/users/b5d521dca09e429f8c20b009335b0bce/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.915446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc29cd87d4644b9be5f11728032dd2f, user_id=b5d521dca09e429f8c20b009335b0bce, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.919331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68b81-8b0a-4e8a-8f56-7b38de550784 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:48.312468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1250/2456] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:47 2022] PUT /identity/v3/projects/dfc29cd87d4644b9be5f11728032dd2f/users/b5d521dca09e429f8c20b009335b0bce/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:48.335099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:48.335528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:48.335909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:48.401339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:48.401586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:48.401909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:48.500174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:48.516349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:48.516452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] MFA Rules not processed for user `b5d521dca09e429f8c20b009335b0bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:48.520162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:48.618881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:48.748690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1251/2457] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:48.834782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1207/2458] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:48.855693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:48.857189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:48.949803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:48.951309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:49.099639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14867b93-d0b4-4238-9cde-a4abc72b282f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:49.113118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:49.115168 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:49.116763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:49.117313 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:49.140724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:49.145633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:49.168079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc3fa-c777-425b-b26d-8a2f1cff66d1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:49.173190 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1252/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:49.194332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:49.198179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:49.198465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:49.198744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:49.239295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:49.249708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:49.253639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c4ce6-2188-41b5-8c2d-701433c9d776 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:49.264265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915598c5-4e40-4db1-bb29-a3dd7d39a761 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:49.281125 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:49.292719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:49.293062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1208/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:49.293195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:49.293195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] PATH_INFO: `/v3/users/b5d521dca09e429f8c20b009335b0bce` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:49.293608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d521dca09e429f8c20b009335b0bce)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:49.295722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:49.672766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d521dca09e429f8c20b009335b0bce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:49.701247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d521dca09e429f8c20b009335b0bce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:49.714613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d521dca09e429f8c20b009335b0bce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:49.720408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d521dca09e429f8c20b009335b0bce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:49.721174 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d521dca09e429f8c20b009335b0bce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:49.878205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1253/2461] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:21:49 2022] DELETE /identity/v3/users/b5d521dca09e429f8c20b009335b0bce => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:49.886586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:49.889585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:49.891168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:49.944406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:49.946445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:50.114677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1209/2462] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:50.122133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:50.126851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:50.129320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:50.262496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c16b-a628-42b0-932d-81757885e8ba admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:50.267617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:50.268573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:50.269092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:50.269642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:50.295725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:50.297968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb0a7a-7a2c-40bb-a671-872c95136faa service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:50.316426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1254/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:50.385677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:51.644734 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:51.655151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:51.805918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cdf01-64d5-4af9-86b1-fc0379394bd9 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:51.805918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:51.805918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:51.805918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:51.807826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] PATH_INFO: `/v3/projects/dfc29cd87d4644b9be5f11728032dd2f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:51.807826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc29cd87d4644b9be5f11728032dd2f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:51.807826 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:51.979360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc29cd87d4644b9be5f11728032dd2f', 'request_id': 'req-ecfcb882-e286-4bf9-b963-de29fa21e6cc'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:52.159080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc29cd87d4644b9be5f11728032dd2f', 'request_id': 'req-ecfcb882-e286-4bf9-b963-de29fa21e6cc'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:52.174321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc29cd87d4644b9be5f11728032dd2f', 'request_id': 'req-ecfcb882-e286-4bf9-b963-de29fa21e6cc'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:52.227521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] The token cache is being invalidate because project dfc29cd87d4644b9be5f11728032dd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:52.231220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:52.236079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ecfcb882-e286-4bf9-b963-de29fa21e6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:52.239883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1210/2464] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:21:51 2022] DELETE /identity/v3/projects/dfc29cd87d4644b9be5f11728032dd2f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:52.245736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:52.246310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:52.246310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:52.267227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:52.283549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:52.284915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:52.378691 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1255/2465] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:52.387008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:52.387307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:52.387572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:52.429431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:52.430687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:52.448690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1211/2466] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:52.452909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:52.478113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92332ca0-45ec-428f-bd75-8222f651f37c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:52.485018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:52.488289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:52.488958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:52.489445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:52.492359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:52.493094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:52.496897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:52.529223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1256/2467] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:52.533908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:52.546691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f65aae-1cdb-4ea9-85dc-d8b513b0e829 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:52.559401 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:52.560098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:52.560429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:52.560703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:52.561413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:52.563452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:52.751236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1212/2468] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:21:52 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:52.751856 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:52.765623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c8a96-aeab-4849-844d-7d1052b6f76c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:52.787871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:52.967466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:52.971827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:52.971827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:52.971827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:52.971827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:52.974283 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:53.180643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:53.195873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1257/2469] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:21:52 2022] POST /identity/v3/users => generated 295 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:53.200069 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b894d3b-9a39-44fe-a311-8192f28e45cb admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:53.283479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:53.283479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:53.283479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:53.283479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:53.283999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:53.283999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:53.283999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1213/2470] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:53.284332 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:53.296747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680882d-5197-417c-a821-154aee325d16 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:53.311721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:53.312092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:53.312417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:53.312699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:53.313510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:53.316518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b19be4-89d6-4b18-85a2-cd8b86ac71a3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:53.350948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:53.363044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1258/2471] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:53.365679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185ed8b-1baa-4ae8-bb74-30620cc0a5ac admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:53.370522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:53.371430 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:53.371714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:53.371990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] PATH_INFO: `/v3/projects/c5652fb4cd83475db956a7523849d2a5/users/376fc70f42ba445c95eb6e3859bded03/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:53.395083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5652fb4cd83475db956a7523849d2a5, user_id=376fc70f42ba445c95eb6e3859bded03, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:53.398420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:53.658724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1214/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:21:53 2022] PUT /identity/v3/projects/c5652fb4cd83475db956a7523849d2a5/users/376fc70f42ba445c95eb6e3859bded03/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:53.672523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362ef-2ea7-4b93-bec9-a411f1f619d8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:53.672844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362ef-2ea7-4b93-bec9-a411f1f619d8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:53.673091 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362ef-2ea7-4b93-bec9-a411f1f619d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:53.736610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a2f362ef-2ea7-4b93-bec9-a411f1f619d8 None None] MFA Rules not processed for user `376fc70f42ba445c95eb6e3859bded03`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:53.738879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a2f362ef-2ea7-4b93-bec9-a411f1f619d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:53.887664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1259/2473] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:53.900984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:53.903238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:54.061895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e2da6-1796-4a55-b2e7-685896ed1e83 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:54.070394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:54.071914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:54.073007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:54.074712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:54.098383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:54.103269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:54.130534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1215/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:54.233649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64e6b-e400-4ec8-b020-3027b9eaa75a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:54.233991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64e6b-e400-4ec8-b020-3027b9eaa75a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:54.234239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64e6b-e400-4ec8-b020-3027b9eaa75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:54.286662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7fe64e6b-e400-4ec8-b020-3027b9eaa75a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:54.290436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fe64e6b-e400-4ec8-b020-3027b9eaa75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:54.478111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1260/2475] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:21:54.536270 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:54.557261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:54.559443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:54.727454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a52b-2f2e-4f63-8080-b2db08048de6 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:54.742690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:54.743803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:54.744102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:54.744497 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:54.755804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:54.758203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:54.792232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1216/2476] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:55.437694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:56.600058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:56.703739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:57.949993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f3f9-b271-4895-a429-b5a1e1d07a32 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:57.950657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f3f9-b271-4895-a429-b5a1e1d07a32 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:57.951050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f3f9-b271-4895-a429-b5a1e1d07a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:57.994879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e9e7f3f9-b271-4895-a429-b5a1e1d07a32 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:57.995776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e9e7f3f9-b271-4895-a429-b5a1e1d07a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:58.035924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1261/2477] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:58.064699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:58.081466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c23539-a724-4fc9-9734-8273149ee4e6 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:58.104800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:58.110530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:58.110530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:58.110530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:58.127406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:58.129104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8662ed-82be-4f84-8128-a05f27b03584 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:58.189529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1217/2478] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:58.542433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:59.134186 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:00.729987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:00.730646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:00.730646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:00.765436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] MFA Rules not processed for user `7f1be00a0a774a9e97c55338b7fa710b`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:00.766805 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:00.850882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1262/2479] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:01.056181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:01.358975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:02.804092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:02.868705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:03.690898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:04.671153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:05.279419 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:06.690423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:06.789314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:06.861092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:06.861385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:06.861664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:06.881567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:06.884125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:06.951463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1218/2480] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:06.965393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:06.967218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:07.049648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102db0c-8bbd-41f9-9c07-e2be99a09c27 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:07.055909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:07.056658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:07.057229 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:07.057508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:07.066149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:07.067721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f912e-5c3f-4705-bc91-6115b3ebf7b0 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:07.076321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1263/2481] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:22:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:22:08.186366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:08.838626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:09.444433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:09.549931 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:09.563752 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967f871-52a3-4d12-b6a7-1ab77d91c799 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:09.568397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:09.569272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:09.569577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:09.569881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] PATH_INFO: `/v3/users/376fc70f42ba445c95eb6e3859bded03` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:09.572333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376fc70f42ba445c95eb6e3859bded03)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:09.573143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:09.811894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376fc70f42ba445c95eb6e3859bded03'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:09.824812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376fc70f42ba445c95eb6e3859bded03'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:09.825793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376fc70f42ba445c95eb6e3859bded03'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:09.826400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376fc70f42ba445c95eb6e3859bded03'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:09.834299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376fc70f42ba445c95eb6e3859bded03'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:09.956719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1219/2482] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:22:09 2022] DELETE /identity/v3/users/376fc70f42ba445c95eb6e3859bded03 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:09.962806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:09.963310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:09.963310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:09.982653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:09.983946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:10.047210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1264/2483] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:10.056876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:10.058424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:10.119012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e513f4-b114-4af9-9df9-5b788ad30fa5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:10.122809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:10.123461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:10.123744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:10.124019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:10.134385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:10.135814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:10.146167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1220/2484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:22:10.466641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:10.468160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:10.626923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e91bae-fdd0-4779-ba07-3917eabcff8a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:10.632747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:10.635179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:10.635575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:10.635952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:10.638097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:10.653295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:10.655293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:10.669779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1265/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:10.770259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:10.833619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:10.847661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:10.847661 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:10.863245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101812d1-1ddf-4ae7-8410-69ad7d153658 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:10.878611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:10.879886 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:10.880453 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:10.881609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] PATH_INFO: `/v3/projects/c5652fb4cd83475db956a7523849d2a5` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:10.883367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5652fb4cd83475db956a7523849d2a5)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:10.885910 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:11.069975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5652fb4cd83475db956a7523849d2a5', 'request_id': 'req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:11.238584 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5652fb4cd83475db956a7523849d2a5', 'request_id': 'req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:11.245956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5652fb4cd83475db956a7523849d2a5', 'request_id': 'req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:11.262002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] The token cache is being invalidate because project c5652fb4cd83475db956a7523849d2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:22:11.262650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:11.263323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:11.265017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1221/2486] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:22:10 2022] DELETE /identity/v3/projects/c5652fb4cd83475db956a7523849d2a5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:11.582415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:11.584472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:11.600855 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca297a-4c77-46fa-ac19-afb514f676e3 service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:11.702844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:11.704310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:11.704789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:11.706502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] PATH_INFO: `/v3/users/2ed266f163ec4affa70580d2602d0720` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:11.709683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed266f163ec4affa70580d2602d0720)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:11.713238 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:11.777087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:12.141116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed266f163ec4affa70580d2602d0720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.152634 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed266f163ec4affa70580d2602d0720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.159712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed266f163ec4affa70580d2602d0720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.160573 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed266f163ec4affa70580d2602d0720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.161268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-bc2a21a7-0765-4944-9f8b-c74b191def6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed266f163ec4affa70580d2602d0720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.306334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1266/2487] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:22:11 2022] DELETE /identity/v3/users/2ed266f163ec4affa70580d2602d0720 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:12.589896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:12.591439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:12.613325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7004f-e3ad-4bc4-99c1-10e7ee642f69 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:12.671845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:12.672687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:12.672968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:12.673239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] PATH_INFO: `/v3/projects/8f40426c82a64732b83846425c5b5be9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:12.674522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f40426c82a64732b83846425c5b5be9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:12.676574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:12.798846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:12.876213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f40426c82a64732b83846425c5b5be9', 'request_id': 'req-28a200db-a621-454a-a781-61c55913af24'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.970466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f40426c82a64732b83846425c5b5be9', 'request_id': 'req-28a200db-a621-454a-a781-61c55913af24'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:12.984463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f40426c82a64732b83846425c5b5be9', 'request_id': 'req-28a200db-a621-454a-a781-61c55913af24'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:13.000642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] The token cache is being invalidate because project 8f40426c82a64732b83846425c5b5be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:22:13.001030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:13.001780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-28a200db-a621-454a-a781-61c55913af24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:13.004177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1222/2488] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:22:12 2022] DELETE /identity/v3/projects/8f40426c82a64732b83846425c5b5be9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:13.009925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.010840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.011412 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.015799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:13.066055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:13.068259 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:13.156253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1267/2489] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:13.163750 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.164168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.164551 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.186276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:13.188096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:13.198180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1223/2490] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:22:13.201989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.215918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89bba3-959b-4f26-8333-65086688cb6e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.221054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.221730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.222374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.222950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.223831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:22:13.224139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.227389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.250547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1268/2491] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:22:13.250865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.259690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd285-b564-4c61-a645-327eecec0d1b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.273939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.274857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.275141 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.275414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.276123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.278144 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.390620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1224/2492] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:22:13.394971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.405843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef8-5709-4c01-916d-8496c60d989a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.463370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.464035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.464426 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.464699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.465373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.467299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.623225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1269/2493] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:22:13.624499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.635300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf612e-7bc5-4aeb-9bec-450b12a269e8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.642261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.642960 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.643473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.643749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.647959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.657776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.672029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1225/2494] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:22:13.675975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.689510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39daa-2198-4562-887a-ace58e56cf7c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.694821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.695420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.695730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.696003 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.696763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.698369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed575b1-4080-4b1f-8e7b-f19ef15e3dfe admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.713562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1270/2495] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:22:13.715406 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.726613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb009fb-7433-4865-a7df-8c87fc31dacf admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:13.733197 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:13.734811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.735092 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.735420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] PATH_INFO: `/v3/projects/282121c129264f45a9bcbde1da3c65ce/users/3224ba06688d4c30a7748c02684a8085/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.768038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282121c129264f45a9bcbde1da3c65ce, user_id=3224ba06688d4c30a7748c02684a8085, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:13.773399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753246f-2fc8-4f98-bbab-d6c2c622d363 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:13.809356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.809668 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.809945 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.832041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:13.834609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:13.868482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1226/2496] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:22:13 2022] PUT /identity/v3/projects/282121c129264f45a9bcbde1da3c65ce/users/3224ba06688d4c30a7748c02684a8085/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:13.879335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:13.879758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:13.881664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:13.904334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1271/2497] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:22:13.917407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:13.917872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] MFA Rules not processed for user `3224ba06688d4c30a7748c02684a8085`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:13.918974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:13.919452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:14.012461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1227/2498] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:14.024300 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a080cc6-d7b1-46c5-9aae-e8195884414a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:14.024761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:14.026387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:14.111272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15a8f-6d80-4f38-9df0-8df30ef3bda1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:14.115489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:14.116522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:14.116811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:14.117088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:14.120400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:14.121247 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:14.121648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:14.122022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:14.133043 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:14.134913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73769b-8938-46cd-815b-95735c2a7b2e service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:14.158662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1228/2499] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:22:14.199680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:14.203055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8e7bf-bd2a-4ca6-b10d-39d2832e4194 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:14.221675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1272/2500] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:22:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:22:15.595646 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:15.596146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:15.596390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:15.598782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1229/2501] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:22:15.604329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:15.604841 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:15.604940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:15.694216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:15.696550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:15.922950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1273/2502] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:15.936379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:15.938372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:15.967652 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bc24-a3d4-4452-9535-f1b89c94eb80 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:15.980898 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:15.981810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:15.982167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:15.982789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:15.999202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:16.001522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a043-6d0e-45a0-b599-c324db2e6865 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:16.023498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1230/2503] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:17.793163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:17.881814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8c71-7ec6-435c-9e37-dd7f3c8fc32f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:17.887025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:17.888181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:17.888580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:17.888952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] PATH_INFO: `/v3/users/3224ba06688d4c30a7748c02684a8085` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:17.890302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3224ba06688d4c30a7748c02684a8085)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:17.892829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:18.190624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3224ba06688d4c30a7748c02684a8085'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:18.197036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:18.242969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3224ba06688d4c30a7748c02684a8085'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:18.251551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3224ba06688d4c30a7748c02684a8085'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:18.252399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3224ba06688d4c30a7748c02684a8085'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:18.253023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3224ba06688d4c30a7748c02684a8085'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:18.296090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:18.420296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1274/2504] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:22:17 2022] DELETE /identity/v3/users/3224ba06688d4c30a7748c02684a8085 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:18.422350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db6b44-94e2-4c23-a961-9110c4977446 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:18.422684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db6b44-94e2-4c23-a961-9110c4977446 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:18.422990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db6b44-94e2-4c23-a961-9110c4977446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:18.458169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b5db6b44-94e2-4c23-a961-9110c4977446 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:18.460383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b5db6b44-94e2-4c23-a961-9110c4977446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:18.560016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1231/2505] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:18.570568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:18.572715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:18.681806 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414cd34-255e-4677-97bc-d65f73783a8c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:18.685799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:18.686980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:18.687465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:18.687921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:18.703478 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:18.706954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:18.719357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1275/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:22:19.109013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ec284-fd4c-4361-a65e-df0bd3276ed0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:19.109576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ec284-fd4c-4361-a65e-df0bd3276ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:19.109966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ec284-fd4c-4361-a65e-df0bd3276ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:19.157636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-eb7ec284-fd4c-4361-a65e-df0bd3276ed0 None None] MFA Rules not processed for user `cec8659660e344109a2f8618db492f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:19.168273 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-eb7ec284-fd4c-4361-a65e-df0bd3276ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:19.248722 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1232/2507] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:19.353570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:19.355043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:19.369719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665804-c3a0-4524-bbe5-c9b08cc637c1 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:19.383098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:19.384191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:19.384681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:19.384960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] PATH_INFO: `/v3/projects/282121c129264f45a9bcbde1da3c65ce` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:19.401664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282121c129264f45a9bcbde1da3c65ce)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:19.404080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:19.604940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282121c129264f45a9bcbde1da3c65ce', 'request_id': 'req-509b4875-764c-44b6-b396-2a038d4d99c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:19.730103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282121c129264f45a9bcbde1da3c65ce', 'request_id': 'req-509b4875-764c-44b6-b396-2a038d4d99c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:19.730103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282121c129264f45a9bcbde1da3c65ce', 'request_id': 'req-509b4875-764c-44b6-b396-2a038d4d99c2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:19.774272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] The token cache is being invalidate because project 282121c129264f45a9bcbde1da3c65ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:22:19.774847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:19.775763 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-509b4875-764c-44b6-b396-2a038d4d99c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:19.782992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876303-4e71-4448-9427-b571377713c1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:19.784269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876303-4e71-4448-9427-b571377713c1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:19.784794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876303-4e71-4448-9427-b571377713c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:19.786839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1276/2508] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:22:19 2022] DELETE /identity/v3/projects/282121c129264f45a9bcbde1da3c65ce => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:19.850458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f1876303-4e71-4448-9427-b571377713c1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:19.850666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f1876303-4e71-4448-9427-b571377713c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:19.949801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:19.950167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:19.950480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:19.952239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1233/2509] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:19.976187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:19.984509 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:19.992517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876303-4e71-4448-9427-b571377713c1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.003432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1277/2510] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:20.003821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876303-4e71-4448-9427-b571377713c1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.009920 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.010622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.010897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.011172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.011957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:22:20.012468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.015305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.035589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.042296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1234/2511] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:22:20.046815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabab46-3049-4936-a7b7-fca6e20478df None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.053362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.054415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.055609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.055609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.055964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.058242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.244040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1278/2512] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:22:20 2022] POST /identity/v3/projects => generated 397 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:22:20.249955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.265972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660458-3936-42a6-8a4b-e673bf3662be admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.366387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.367180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.367541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.367882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.368883 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.371382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.601294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1235/2513] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:22:20 2022] POST /identity/v3/users => generated 299 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:22:20.605111 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.616898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055aa14-957b-4404-83a0-8cd0a5acd4d8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.622676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.623661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.624127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.624604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.625488 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.627843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.655941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.658701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1279/2514] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:22:20.671123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfa76-54b5-44ab-a8c8-4ac3a72f5ed7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.679013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.680184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.680845 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.681346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.682317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.684346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ca81-71c7-43d0-8db5-8ed378e6f50b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.709156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1236/2515] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:22:20.714026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:20.725975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4660a-3a27-445e-b4c7-91f22dfb4993 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:20.743492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:20.744799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.745368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.745797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] PATH_INFO: `/v3/projects/4e8e0792e312473689d851bdabee2f9c/users/de11b05fa60b4dd3b1db5c59d5fa1130/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.782203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8e0792e312473689d851bdabee2f9c, user_id=de11b05fa60b4dd3b1db5c59d5fa1130, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:20.789931 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0831773-8478-4d37-94b1-5541495a6293 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:20.917182 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1280/2516] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:22:20 2022] PUT /identity/v3/projects/4e8e0792e312473689d851bdabee2f9c/users/de11b05fa60b4dd3b1db5c59d5fa1130/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:20.926321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.926637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.927418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.931618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047aa99-5a44-45d9-b82a-b6f64db20f41 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:20.931911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047aa99-5a44-45d9-b82a-b6f64db20f41 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:20.932289 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047aa99-5a44-45d9-b82a-b6f64db20f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:20.968127 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] MFA Rules not processed for user `e8859d79ab924bb585b04f69f93ca211`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:20.975057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:21.011087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d047aa99-5a44-45d9-b82a-b6f64db20f41 None None] MFA Rules not processed for user `de11b05fa60b4dd3b1db5c59d5fa1130`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:21.014796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d047aa99-5a44-45d9-b82a-b6f64db20f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:21.084915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1237/2517] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:21.169019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1281/2518] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:21.178724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:21.180306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:21.294946 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c91d3-bb62-4615-b197-84ae3a73802c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:21.299143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:21.299810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:21.300181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:21.300492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:21.312802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:21.314501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:21.355908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1238/2519] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:21.486086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:21.605209 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514476-2beb-470e-b255-06203d471615 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:21.606078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514476-2beb-470e-b255-06203d471615 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:21.606078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514476-2beb-470e-b255-06203d471615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:21.686996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-99514476-2beb-470e-b255-06203d471615 None None] MFA Rules not processed for user `86f0d82258784b198c8d088b52dec0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:21.688536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-99514476-2beb-470e-b255-06203d471615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:21.832071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1282/2520] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:22:22.907759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:25.541833 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:26.713518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:28.036731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:28.141045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4c190-60a6-459e-823f-7a3064994a3b service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:28.153379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:28.154307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:28.154562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:28.154831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] PATH_INFO: `/v3/users/de11b05fa60b4dd3b1db5c59d5fa1130` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:28.156103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de11b05fa60b4dd3b1db5c59d5fa1130)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:28.162502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:28.449460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de11b05fa60b4dd3b1db5c59d5fa1130'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:28.487764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de11b05fa60b4dd3b1db5c59d5fa1130'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:28.488545 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de11b05fa60b4dd3b1db5c59d5fa1130'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:28.489767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de11b05fa60b4dd3b1db5c59d5fa1130'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:28.507751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de11b05fa60b4dd3b1db5c59d5fa1130'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:28.615199 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1239/2521] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:22:28 2022] DELETE /identity/v3/users/de11b05fa60b4dd3b1db5c59d5fa1130 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:28.620393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:28.621352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:28.621864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:28.641863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:28.643490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:28.659307 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:28.714677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1283/2522] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:28.756319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:28.759807 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:28.865321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb49a0-69a5-4003-bfe0-81cd594e0d10 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:28.870291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:28.870634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:28.870975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:28.871432 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:28.900875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:28.902711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:28.914309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1240/2523] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:22:29.696477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:29.925109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:29.926900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:29.952181 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfac0c0-d5e5-4bfb-870b-4dff208498ae None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:29.959113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:29.960087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:29.961059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:29.962077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] PATH_INFO: `/v3/projects/4e8e0792e312473689d851bdabee2f9c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:29.969970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8e0792e312473689d851bdabee2f9c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:29.970949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:30.111701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8e0792e312473689d851bdabee2f9c', 'request_id': 'req-a832a320-0d0b-48ce-9cd0-552134ec2720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:30.249626 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8e0792e312473689d851bdabee2f9c', 'request_id': 'req-a832a320-0d0b-48ce-9cd0-552134ec2720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:30.259497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8e0792e312473689d851bdabee2f9c', 'request_id': 'req-a832a320-0d0b-48ce-9cd0-552134ec2720'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:30.287173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] The token cache is being invalidate because project 4e8e0792e312473689d851bdabee2f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:22:30.288228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:30.289349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a832a320-0d0b-48ce-9cd0-552134ec2720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:30.292737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1284/2524] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:22:29 2022] DELETE /identity/v3/projects/4e8e0792e312473689d851bdabee2f9c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:31.353130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:31.384151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:32.294968 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:32.329363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:33.230495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:34.661660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:36.547367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:40.255756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:40.306674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:40.713662 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:40.722274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118502-910c-425d-ad76-f72d265aff47 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:40.776951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:40.778033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:40.778341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:40.779308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:40.780743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:40.843200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:40.845148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:40.856295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1241/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:43.133272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:44.067754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:46.849471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:46.981088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:49.748249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5104bc-1e2a-4f00-b545-844446b5b165 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:49.748959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5104bc-1e2a-4f00-b545-844446b5b165 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:49.748959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5104bc-1e2a-4f00-b545-844446b5b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:49.767672 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6c5104bc-1e2a-4f00-b545-844446b5b165 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:49.768892 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6c5104bc-1e2a-4f00-b545-844446b5b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:49.833497 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1285/2526] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:22:49.850625 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:49.853605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:49.925165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a566fc-3e9f-4c07-ba14-72bad20ca053 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:49.931496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:49.932326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:49.932607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:49.932882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:49.942169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:49.943758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:49.953012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1242/2527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:50.521305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:50.566895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:51.326756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:51.574498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:51.991986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:52.649198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:53.271935 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0b29-93ff-49f5-9462-be403a11bb95 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:53.272142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0b29-93ff-49f5-9462-be403a11bb95 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:53.272437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0b29-93ff-49f5-9462-be403a11bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:53.291714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-e8fb0b29-93ff-49f5-9462-be403a11bb95 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:53.292975 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-e8fb0b29-93ff-49f5-9462-be403a11bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:53.301731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1286/2528] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:53.319243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:53.320715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:53.335838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed91699-1052-4380-a2d9-2babdcd63f93 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:53.342133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:53.342687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:53.342965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:53.343234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:53.352867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:53.357542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:53.364438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1243/2529] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:53.717223 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:53.766429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:54.483026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:54.511992 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:54.743982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:54.780326 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:54.980070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.077343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.563049 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.625906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.832593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.926998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:55.960661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:56.130872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a87-78bc-497d-b030-c00f24aaa4a8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:56.131153 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a87-78bc-497d-b030-c00f24aaa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:56.131425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a87-78bc-497d-b030-c00f24aaa4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:56.148895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-8eb63a87-78bc-497d-b030-c00f24aaa4a8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:56.150227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8eb63a87-78bc-497d-b030-c00f24aaa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:56.158402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1287/2530] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:56.173007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:56.185121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c14-f180-470c-9a56-e8512473b8ca service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:56.188364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:56.190781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:56.192072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:56.192387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:56.192660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:56.201501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:56.203085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:56.212825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1244/2531] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:56.383791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:56.480893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:56.763248 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:56.797568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.000754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.025720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.192370 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.303823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.391697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.497873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.766549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:57.938069 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.125046 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.160818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.443590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.594864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.694505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.728913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.843426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.871814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.957642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.994838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.292457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.323021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.586191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.700138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.888273 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:59.997451 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:00.052646 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:00.389799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:00.427687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c525c6-0d72-41ab-8ce5-989bfbe778ef None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:00.428261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c525c6-0d72-41ab-8ce5-989bfbe778ef None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:00.428696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c525c6-0d72-41ab-8ce5-989bfbe778ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:00.452680 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-75c525c6-0d72-41ab-8ce5-989bfbe778ef None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:00.453836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-75c525c6-0d72-41ab-8ce5-989bfbe778ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:00.462097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1288/2532] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:00.465688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:00.478630 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:00.490973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4738dc7-9c15-43ae-bdb1-6f0561e28112 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:00.496961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:00.497616 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:00.497893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:00.498164 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:00.513400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:00.515109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:00.525332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1245/2533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:23:00.888934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:00.946491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:01.138305 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:01.352013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:01.433413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:01.983644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.146249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.248269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.280603 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.560436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.591692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:02.859764 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:03.077387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:03.425730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:03.774236 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:03.796104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:03.796104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:03.796104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:03.813965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:03.815156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:03.823900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1289/2534] 10.222.0.71 () {58 vars in 1016 bytes} [Thu May 19 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:03.846407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:03.851501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2cf47-f944-42fb-bd35-03489a61d8d5 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:03.856848 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:03.857504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:03.857779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:03.858049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:03.866533 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:03.868101 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:03.877552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1246/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:23:04.368413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:04.657606 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:04.692312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:04.749061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:04.779921 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.048713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.231218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.462900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.497005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.600040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:05.686004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:15.434437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=78 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:15.825152 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=14 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:39.386525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:39.388798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:39.401147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aaf61-ccde-4fd4-854f-d8f6648499be None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:39.407980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:39.409030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:39.409358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:39.409636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] PATH_INFO: `/v3/users/e8859d79ab924bb585b04f69f93ca211` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:39.411056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8859d79ab924bb585b04f69f93ca211)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:39.413352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:39.629012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8859d79ab924bb585b04f69f93ca211'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:39.642743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8859d79ab924bb585b04f69f93ca211'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:39.650200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8859d79ab924bb585b04f69f93ca211'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:39.650943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8859d79ab924bb585b04f69f93ca211'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:39.651560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-e41fdae7-0108-426c-8007-0c3df830431b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8859d79ab924bb585b04f69f93ca211'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:39.744897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1290/2536] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:23:39 2022] DELETE /identity/v3/users/e8859d79ab924bb585b04f69f93ca211 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:23:40.317864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:40.331073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4d3a9-4c4a-4fe2-8c03-59fa4c185301 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:40.406492 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:40.407362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:40.407644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:40.407921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] PATH_INFO: `/v3/projects/b1c21b69b41448eda4751a9d83c60d56` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:40.409193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c21b69b41448eda4751a9d83c60d56)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:40.411140 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:40.532756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c21b69b41448eda4751a9d83c60d56', 'request_id': 'req-e2aa703e-cf69-4937-a95c-b569365974cd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:40.627686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c21b69b41448eda4751a9d83c60d56', 'request_id': 'req-e2aa703e-cf69-4937-a95c-b569365974cd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:40.635449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c21b69b41448eda4751a9d83c60d56', 'request_id': 'req-e2aa703e-cf69-4937-a95c-b569365974cd'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:40.646644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] The token cache is being invalidate because project b1c21b69b41448eda4751a9d83c60d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:23:40.646934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:40.647597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-e2aa703e-cf69-4937-a95c-b569365974cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:23:40.649176 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1247/2537] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:23:40 2022] DELETE /identity/v3/projects/b1c21b69b41448eda4751a9d83c60d56 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:23:40.655346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:40.655857 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:40.655955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:40.674667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:40.676578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:40.743781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1291/2538] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:23:40.751772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:40.752059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:40.752376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:40.770828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:40.772062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:40.780085 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1248/2539] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:40.785220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:40.794928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c24c2-1fbe-42b0-9f0e-771be4cec5e3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:40.800073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:40.800976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:40.801138 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:40.801358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:40.802130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:23:40.802425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:40.803983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:40.817086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1292/2540] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:23:40.821506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:40.831081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb292c-9f0b-4209-b3ee-f416317e9eb8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:40.836237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:40.836867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:40.837137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:40.837398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:40.838086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:40.840019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:40.940779 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1249/2541] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:23:40 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:23:40.944955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:40.959831 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcc313-fe8b-46c5-93b7-3e5b2b164933 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:41.022267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:41.022939 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.023222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.023553 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.024180 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:41.028930 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:41.032745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:41.184425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1293/2542] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:23:40 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:23:41.192747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:41.203068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be4e74-e300-4fc8-b20f-6dce36d6e1c1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:41.210361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:41.211077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.212967 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.213439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.214240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:41.215865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:41.228766 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1250/2543] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:23:41.232640 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:41.243787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b49c-ab16-4010-8eb5-702886fdfc2f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:41.248879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:41.249577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.251149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.251149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.251149 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:41.252560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678936e-15a6-42c4-a1ce-76a6acc78580 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:41.265657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1294/2544] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:23:41.270855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:41.283155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2f7e-0ed5-474b-84eb-fb201208c30d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:41.287837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:41.288781 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.289058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.289325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] PATH_INFO: `/v3/projects/ebccb04b931a426eb1023fb947a980e2/users/a6f521b8eb1f421d999277094956b60f/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.308005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebccb04b931a426eb1023fb947a980e2, user_id=a6f521b8eb1f421d999277094956b60f, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:41.311124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:41.470343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1251/2545] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:23:41 2022] PUT /identity/v3/projects/ebccb04b931a426eb1023fb947a980e2/users/a6f521b8eb1f421d999277094956b60f/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:23:41.476106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8afb8-6d9f-43a7-bb9b-2aae04578f4c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.476542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8afb8-6d9f-43a7-bb9b-2aae04578f4c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.476934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8afb8-6d9f-43a7-bb9b-2aae04578f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.495443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f6b8afb8-6d9f-43a7-bb9b-2aae04578f4c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:41.496732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f6b8afb8-6d9f-43a7-bb9b-2aae04578f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:41.559302 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1295/2546] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:41.569790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:41.571602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:41.603716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:41.631123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df608d-a1b1-4846-8e80-fdfe2a019593 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:41.634742 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:41.635384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:41.635663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:41.635937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:41.645231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:41.647012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:41.658469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1252/2547] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:23:48.479594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:48.480753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:48.480753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:48.523765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] MFA Rules not processed for user `a6f521b8eb1f421d999277094956b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:48.526434 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:48.622127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1296/2548] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:48.627086 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:48.639913 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e653-ca8d-431b-a72e-ac1c6e6b215f service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:48.651267 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:48.653543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:48.653543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:48.653543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:48.654639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:48.658537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:48.760758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1253/2549] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:23:48 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:23:48.765001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:48.781150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b28f-32fd-4046-b2c6-8d0814d55cbe None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:48.853347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:48.853858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:48.854214 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:48.854816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:48.855551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:48.857998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:48.945039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:48.954151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1297/2550] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:23:48 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:23:48.958129 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:48.977389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206328-9066-46a0-93e3-92b205af5284 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:48.990244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:48.990930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:48.991230 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:48.991481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:48.992233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:48.995629 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:49.016803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1254/2551] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:23:49.018875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:49.032660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d63d-3d12-4209-863f-e6223e63ba54 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:49.042220 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:49.043187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:49.044030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:49.044030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] PATH_INFO: `/v3/projects/a1dccb0494444aec8b65b23ecffe958c/users/6f927b56b9484b69a53d90dc1ab37486/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:49.061784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dccb0494444aec8b65b23ecffe958c, user_id=6f927b56b9484b69a53d90dc1ab37486, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:49.064820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:49.194380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1298/2552] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:23:49 2022] PUT /identity/v3/projects/a1dccb0494444aec8b65b23ecffe958c/users/6f927b56b9484b69a53d90dc1ab37486/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:23:49.198397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:49.212384 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c9c0-57b9-4485-90d6-1ab3c18fa515 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:49.280420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:49.281726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:49.282314 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:49.282863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:49.284054 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:49.285865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44739a9-bacb-4755-8d1b-945a81816bb0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:49.300077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1255/2553] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:23:49.305535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:49.316161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa60244-d0da-452e-be1f-6086f83783cd admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:49.326256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:49.327162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:49.327438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:49.328192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] PATH_INFO: `/v3/projects/a1dccb0494444aec8b65b23ecffe958c/users/6f927b56b9484b69a53d90dc1ab37486/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:49.334204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dccb0494444aec8b65b23ecffe958c, user_id=6f927b56b9484b69a53d90dc1ab37486, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:49.334204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdcd84-9798-4bec-b392-07822cd35bd6 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:49.349860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1299/2554] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:23:49 2022] PUT /identity/v3/projects/a1dccb0494444aec8b65b23ecffe958c/users/6f927b56b9484b69a53d90dc1ab37486/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:23:49.884784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51596f7a-b125-4aeb-86d6-083c4b18e86f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:49.885244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51596f7a-b125-4aeb-86d6-083c4b18e86f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:49.885471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51596f7a-b125-4aeb-86d6-083c4b18e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:49.903892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-51596f7a-b125-4aeb-86d6-083c4b18e86f None None] MFA Rules not processed for user `cec8659660e344109a2f8618db492f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:49.905133 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-51596f7a-b125-4aeb-86d6-083c4b18e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:49.973454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1256/2555] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:51.479589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:51.480741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:51.481019 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:51.514978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] MFA Rules not processed for user `86f0d82258784b198c8d088b52dec0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:51.521020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:51.581987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1300/2556] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:56.568901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e57b8-fb5b-4f6a-bff8-231c19698533 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:56.570214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e57b8-fb5b-4f6a-bff8-231c19698533 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:56.570214 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e57b8-fb5b-4f6a-bff8-231c19698533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:56.612326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-296e57b8-fb5b-4f6a-bff8-231c19698533 None None] MFA Rules not processed for user `6f927b56b9484b69a53d90dc1ab37486`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:23:56.613945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-296e57b8-fb5b-4f6a-bff8-231c19698533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:56.646663 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:56.703438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1257/2557] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:23:56.718204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:56.719765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:56.851504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f91d4-b6e9-41d8-89ed-ce69f4374518 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:56.860638 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:56.861320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:56.862262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:56.862545 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:56.978282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:56.980340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:56.992652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1301/2558] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:24:00.382789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:00.383242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:00.383612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:00.404573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] MFA Rules not processed for user `a6f521b8eb1f421d999277094956b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:24:00.406027 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:00.418354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1258/2559] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:24:06.986886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:10.398574 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=20 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:13.975169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:13.977227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:14.033882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89b144-fe36-4bbf-b645-eadf8a5a314a service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:14.037557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:14.038223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:14.040371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:14.040371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:14.040576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:14.055501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:14.056465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc187398-5854-4da6-b182-d5125d96fecb service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:14.068944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1302/2560] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:15.186354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:15.187729 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:15.246878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec6144-e9fd-472f-b943-a9fe95b04861 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:15.250427 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:15.251075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:15.251353 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:15.251622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:15.253398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:15.267420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:15.268923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:15.279998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1259/2561] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:18.888995 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:18.889597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:18.889860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:18.908344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:24:18.909602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:18.972084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1303/2562] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:24:19.020580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:19.022257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:19.097047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00e4e-5aef-42e8-b702-8c8e434e4905 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:19.102158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:19.102803 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:19.107059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:19.107059 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:19.113867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:19.115484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:19.124376 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1260/2563] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:24:26.923437 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:26.935399 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647afbc-86d2-4e87-9447-737b5cd2f762 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:26.940444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:26.940444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:26.940732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:26.940833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:26.953252 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:26.971588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:26.973983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:26.994503 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1304/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:28.975860 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:28.976971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:29.049122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91680dd-80c9-4df4-9260-8f4f9914737e service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:29.053715 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:29.054586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:29.054902 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:29.055173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] PATH_INFO: `/v3/users/7f1be00a0a774a9e97c55338b7fa710b` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:29.056390 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1be00a0a774a9e97c55338b7fa710b)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:29.058373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:29.236415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:29.245450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1be00a0a774a9e97c55338b7fa710b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.257764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1be00a0a774a9e97c55338b7fa710b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.258436 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1be00a0a774a9e97c55338b7fa710b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.259031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1be00a0a774a9e97c55338b7fa710b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.266692 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1be00a0a774a9e97c55338b7fa710b'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.383030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1261/2565] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:24:28 2022] DELETE /identity/v3/users/7f1be00a0a774a9e97c55338b7fa710b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:29.665436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:29.679581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcfdaf-0f74-446d-abcb-4893b36f474f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:29.743900 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:29.744803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:29.745086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:29.745387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] PATH_INFO: `/v3/projects/f936dcd96a554a6fa2ba5147eaf4b117` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:29.746628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f936dcd96a554a6fa2ba5147eaf4b117)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:29.748735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:29.874489 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:29.883592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f936dcd96a554a6fa2ba5147eaf4b117', 'request_id': 'req-c54f27b4-7c94-44d0-98b1-74c328e6c537'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.955011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f936dcd96a554a6fa2ba5147eaf4b117', 'request_id': 'req-c54f27b4-7c94-44d0-98b1-74c328e6c537'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.962100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f936dcd96a554a6fa2ba5147eaf4b117', 'request_id': 'req-c54f27b4-7c94-44d0-98b1-74c328e6c537'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.973593 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] The token cache is being invalidate because project f936dcd96a554a6fa2ba5147eaf4b117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:24:29.974121 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.974799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:29.976420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1305/2566] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:24:29 2022] DELETE /identity/v3/projects/f936dcd96a554a6fa2ba5147eaf4b117 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:29.981667 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:29.983213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:29.984782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:29.986162 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:30.043951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649736ec-dbaa-4617-a7b2-aa1a3df81c25 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:30.052830 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f27b4-7c94-44d0-98b1-74c328e6c537 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:30.058280 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:30.059224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:30.059500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:30.059768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] PATH_INFO: `/v3/users/1f48d680f0614ad792aeb5dedaac55e3` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:30.061085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f48d680f0614ad792aeb5dedaac55e3)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:30.063727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:30.096771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:30.097578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:30.097989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:30.098329 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:30.100355 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:30.163825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:30.165190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:30.174890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1262/2567] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:30.368676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f48d680f0614ad792aeb5dedaac55e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:30.382047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f48d680f0614ad792aeb5dedaac55e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:30.388083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f48d680f0614ad792aeb5dedaac55e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:30.388784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f48d680f0614ad792aeb5dedaac55e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:30.389389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f48d680f0614ad792aeb5dedaac55e3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:30.538272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1306/2568] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:24:29 2022] DELETE /identity/v3/users/1f48d680f0614ad792aeb5dedaac55e3 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:24:30.801636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:30.815295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8787ec-bcff-4775-8440-829ddefedc1e service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:30.830570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:30.875111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:30.876520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:30.876797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:30.877066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] PATH_INFO: `/v3/projects/248901b0f2e140028557db310157c4e9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:30.878313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=248901b0f2e140028557db310157c4e9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:30.880167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:31.051115 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248901b0f2e140028557db310157c4e9', 'request_id': 'req-1678d7f4-4ebf-4764-b364-170ff149c53e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:31.191481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248901b0f2e140028557db310157c4e9', 'request_id': 'req-1678d7f4-4ebf-4764-b364-170ff149c53e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:31.198151 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248901b0f2e140028557db310157c4e9', 'request_id': 'req-1678d7f4-4ebf-4764-b364-170ff149c53e'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:31.208761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] The token cache is being invalidate because project 248901b0f2e140028557db310157c4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:24:31.209047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:31.212579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:31.212579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1263/2569] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:24:30 2022] DELETE /identity/v3/projects/248901b0f2e140028557db310157c4e9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:32.487410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:32.489065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:32.540669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:32.570984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef93de-2c1e-481a-b038-88d006f4f30e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:32.634823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:32.635560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:32.635839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:32.636110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:32.637906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:32.649787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:32.651355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:32.663277 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1307/2570] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:41.454966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:42.658610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=42 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:46.183863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:46.185410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:46.201872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678d7f4-4ebf-4764-b364-170ff149c53e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:46.207567 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:46.208226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:46.208515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:46.208790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:46.210494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:46.268744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:46.274957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:46.280242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1264/2571] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:24:56.276066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=28 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:03.281779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:03.283523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:03.362616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3810c-f763-41dd-9ef0-cade0172c643 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:03.368167 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:03.369100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:03.369590 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:03.369710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] PATH_INFO: `/v3/users/86f0d82258784b198c8d088b52dec0d9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:03.370951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f0d82258784b198c8d088b52dec0d9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:03.373041 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:03.746904 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f0d82258784b198c8d088b52dec0d9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:03.761241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f0d82258784b198c8d088b52dec0d9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:03.769341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f0d82258784b198c8d088b52dec0d9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:03.770083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f0d82258784b198c8d088b52dec0d9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:03.770708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-5a1d6e0c-f217-4e1d-91ab-ac9384aa0dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f0d82258784b198c8d088b52dec0d9'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:03.960009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1308/2572] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:03 2022] DELETE /identity/v3/users/86f0d82258784b198c8d088b52dec0d9 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:04.244019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:04.258856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8905-06d2-4024-90a6-ac3343415e85 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:04.317821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:04.318707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.318990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.319265 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] PATH_INFO: `/v3/projects/ebc93066c5a344f99d07e3e54ef115f7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.320527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc93066c5a344f99d07e3e54ef115f7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:04.322455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:04.437666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc93066c5a344f99d07e3e54ef115f7', 'request_id': 'req-d485ae47-da62-41fd-bfd6-51bf8af84118'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:04.518894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc93066c5a344f99d07e3e54ef115f7', 'request_id': 'req-d485ae47-da62-41fd-bfd6-51bf8af84118'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:04.525434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc93066c5a344f99d07e3e54ef115f7', 'request_id': 'req-d485ae47-da62-41fd-bfd6-51bf8af84118'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:04.536503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] The token cache is being invalidate because project ebc93066c5a344f99d07e3e54ef115f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:04.536795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:04.537445 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d485ae47-da62-41fd-bfd6-51bf8af84118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:04.538995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1265/2573] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:04 2022] DELETE /identity/v3/projects/ebc93066c5a344f99d07e3e54ef115f7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:04.544096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.544625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.544725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.562621 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:04.563797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:04.624549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1309/2574] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:04.631866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.632415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.632535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.651296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:04.652517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:04.660787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1266/2575] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:04.665016 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:04.675417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7483e-b86f-49df-9e0b-4718724e4bbf None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:04.679974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:04.680653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.680938 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.681213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.681925 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:25:04.682231 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:04.683816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:04.695319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1310/2576] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:25:04.699811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:04.709365 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef11ec-b32c-4eab-905f-f1fb1adb50c6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:04.713876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:04.714522 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.714801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.715073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.715745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:04.718226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:04.861005 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1267/2577] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:04 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:04.865098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:04.875146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5734a9-d0c5-4f54-83b6-f74533671591 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:04.878756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:04.933062 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:04.933578 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:04.933860 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:04.934176 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:04.934901 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:04.936874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:05.044098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1311/2578] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:04 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:05.048323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:05.058839 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95f61-4a69-464e-be7c-a7abf1eac385 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:05.063400 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:05.064047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:05.064614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:05.064885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:05.065637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:05.067238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:05.078213 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1268/2579] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:05.082358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:05.093873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95dd2-ba44-4d03-bd94-2aa5824a1357 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:05.098712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:05.099393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:05.099677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:05.100000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:05.100762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:05.102825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532c54-b8a2-468a-9967-739b5aa3c1c1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:05.113287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1312/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:05.117524 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:05.127749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c6529-b05e-49b3-a00f-aa904281d4c9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:05.132525 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:05.133413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:05.134083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:05.134304 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] PATH_INFO: `/v3/projects/89b478cc21194d6680fcd4d6eb5ba4aa/users/d46b4e1ae0bf4744a1b625fbe2ddbbc0/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:05.150392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b478cc21194d6680fcd4d6eb5ba4aa, user_id=d46b4e1ae0bf4744a1b625fbe2ddbbc0, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:05.153324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:05.245212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1269/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:05 2022] PUT /identity/v3/projects/89b478cc21194d6680fcd4d6eb5ba4aa/users/d46b4e1ae0bf4744a1b625fbe2ddbbc0/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:05.250897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:05.251185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:05.251460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:05.270169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:05.271405 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:05.333980 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1313/2582] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:05.343763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:05.345537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:05.378814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:05.406428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3dd-0fe4-452a-b7d0-f0e0be0f76a2 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:05.410009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:05.410643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:05.410923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:05.411193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:05.420412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:05.421850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c0f0-9591-4a04-9c19-e617b85bffa3 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:05.431201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1270/2583] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:08.188755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:08.199264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186467a-2b43-454e-86be-9a864bdf102c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:08.205023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:08.205670 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:08.205947 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:08.206217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:08.207964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:08.220468 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:08.221881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:08.232144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1314/2584] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:12.193853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:12.197959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:12.197959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:12.235685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] MFA Rules not processed for user `d46b4e1ae0bf4744a1b625fbe2ddbbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:12.237249 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:12.343060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1271/2585] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:12.364585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:12.365150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:12.465242 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076344-d42c-433e-8017-26ac9fac27ad service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:12.472751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:12.473779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:12.474212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:12.474642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:12.483869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:12.485525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:12.489461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:12.497466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1315/2586] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:13.275503 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:13.277201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:13.294105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88a0b3-1168-4eff-bded-5ca725438cbd None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:13.299319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:13.300831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:13.301114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:13.301393 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] PATH_INFO: `/v3/users/cec8659660e344109a2f8618db492f46` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:13.303050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec8659660e344109a2f8618db492f46)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:13.305648 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:13.552866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec8659660e344109a2f8618db492f46'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:13.570252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec8659660e344109a2f8618db492f46'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:13.571081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec8659660e344109a2f8618db492f46'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:13.571873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec8659660e344109a2f8618db492f46'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:13.580534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ac90a734-fd38-458a-bc1c-973287f03fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec8659660e344109a2f8618db492f46'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:13.674033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1272/2587] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:13 2022] DELETE /identity/v3/users/cec8659660e344109a2f8618db492f46 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:14.020697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:14.036472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ce23-7f31-48b6-82ad-0338ab9ed63c service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:14.100698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:14.101563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.101844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.102118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] PATH_INFO: `/v3/projects/44e1e4e4548e4ce9a11e07f110ec9d9f` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.103352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e1e4e4548e4ce9a11e07f110ec9d9f)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:14.105271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:14.253048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e1e4e4548e4ce9a11e07f110ec9d9f', 'request_id': 'req-3259055e-7f78-4b04-a952-2be8c378eba2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:14.343211 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e1e4e4548e4ce9a11e07f110ec9d9f', 'request_id': 'req-3259055e-7f78-4b04-a952-2be8c378eba2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:14.355324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e1e4e4548e4ce9a11e07f110ec9d9f', 'request_id': 'req-3259055e-7f78-4b04-a952-2be8c378eba2'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:14.380863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] The token cache is being invalidate because project 44e1e4e4548e4ce9a11e07f110ec9d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:14.381161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:14.381838 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-3259055e-7f78-4b04-a952-2be8c378eba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:14.386916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1316/2588] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:14 2022] DELETE /identity/v3/projects/44e1e4e4548e4ce9a11e07f110ec9d9f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:14.388747 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.389201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.389511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.416372 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:14.417727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:14.446636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:14.485297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1273/2589] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:14.493617 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.493906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.494187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.520598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:14.522559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:14.532998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1317/2590] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:14.537582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:14.547812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dfcea-ebed-47e3-b83d-318962bb68d1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:14.553282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:14.553940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.554222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.554494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.555488 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:25:14.555797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:14.557670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:14.577624 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1274/2591] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:25:14.578796 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:14.595303 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fafbcf-cdb2-4c35-ad9a-80f03b345f18 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:14.603464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:14.604319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.604997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.604997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.609843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:14.613669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:14.763147 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1318/2592] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:14 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:25:14.767987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:14.794570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3747c-109a-410b-b579-4ebb17959ba4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:14.924106 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:14.924842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:14.925082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:14.925360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:14.926114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:14.928231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.055180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1275/2593] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:14 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:25:15.060961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.074997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033b420-4138-445c-ad78-3d58f8430ee0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.080525 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.081201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.081484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.081754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.082692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.084110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.099441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1319/2594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:15.100609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.111943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32a87-34e2-4db1-8163-4c3500aaf70a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.118958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.119704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.120193 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.120505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.121232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.123767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b51852-e177-4b81-b4b6-7e7971ce38c6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.137061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1276/2595] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:15.145244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.160795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f27cc-e68c-4d30-a9b3-336cd980ee37 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.176786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.176786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.176786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.176786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] PATH_INFO: `/v3/projects/b4515c6c40f34368a27e204aeedfc7f7/users/de34912c6ff6459d89146a17b51e02f7/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.207759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4515c6c40f34368a27e204aeedfc7f7, user_id=de34912c6ff6459d89146a17b51e02f7, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.210696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.302708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.302936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1320/2596] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:15 2022] PUT /identity/v3/projects/b4515c6c40f34368a27e204aeedfc7f7/users/de34912c6ff6459d89146a17b51e02f7/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:15.303053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.303053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.341982 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] MFA Rules not processed for user `de34912c6ff6459d89146a17b51e02f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:15.344404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:15.427589 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1277/2597] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:15.432173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.451502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:15.499030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188d99-785a-4a07-8067-1b1e12c1436c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.503959 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.504758 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.505124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.505477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.506248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.508424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a0ed-7abe-4cb5-b5b9-09481da629b7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.635278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1321/2598] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:15 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:15.639242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.650899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f813ff6-129d-4dc0-bfc2-d48ee18e6523 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.678620 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:15.687110 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.687393 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.687694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.709627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] MFA Rules not processed for user `d46b4e1ae0bf4744a1b625fbe2ddbbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:15.711119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:15.715029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.715963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.716285 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.716568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.718072 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.720466 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.771895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1322/2599] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:15.839824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1278/2600] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:15 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:25:15.843133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.859612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98caf64-3086-4978-b0a1-81187a810fad None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.868172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.873777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.873777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.873777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.873777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.873777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:15.886506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1323/2601] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:25:15.888110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:15.899407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc9f-ea4a-446c-9120-f967d7223ec4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:15.905070 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:15.906155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:15.906623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:15.906908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] PATH_INFO: `/v3/projects/b86f08602a9943a48634d5cade34b2c0/users/d19eac3cbc2445d2b5f6a941dbe6b971/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:15.925713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86f08602a9943a48634d5cade34b2c0, user_id=d19eac3cbc2445d2b5f6a941dbe6b971, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:15.929038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.017819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1279/2602] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:15 2022] PUT /identity/v3/projects/b86f08602a9943a48634d5cade34b2c0/users/d19eac3cbc2445d2b5f6a941dbe6b971/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:16.022563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.034615 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adff24-56d8-47bf-a86b-aff44fef73d7 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.111867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.113808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.115087 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.115748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.116023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.116327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.117047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.119508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.131179 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1324/2603] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:16.134879 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.145883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61223-08c7-4b4e-a7af-d1d102c7bcc8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.151227 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.152239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.152601 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.152946 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] PATH_INFO: `/v3/projects/b86f08602a9943a48634d5cade34b2c0/users/d19eac3cbc2445d2b5f6a941dbe6b971/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.155589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86f08602a9943a48634d5cade34b2c0, user_id=d19eac3cbc2445d2b5f6a941dbe6b971, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.158358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121e18-0db8-49ac-854a-8bd764b91a66 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.170826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1325/2604] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:16 2022] PUT /identity/v3/projects/b86f08602a9943a48634d5cade34b2c0/users/d19eac3cbc2445d2b5f6a941dbe6b971/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:25:16.182154 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.182440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.182725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.184156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b95f-bc5d-44e0-9ea4-8267381771f6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.212802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] MFA Rules not processed for user `d19eac3cbc2445d2b5f6a941dbe6b971`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:16.214020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.220219 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:16.237689 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.238412 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.238836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.239232 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.242190 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.252413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.253836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.262460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1280/2605] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:25:16.286401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1326/2606] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:16.298887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.300409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.367021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d9e2a-0ac6-4edb-be5b-1dcbac5bf90a service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.372122 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.373216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.373851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.373851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.380326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:16.385180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.386638 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.398455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1281/2607] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:16.713644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.723541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dad32e-2455-4e33-a29a-30fa3155792e None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.728067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.728825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.729115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.729451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.744996 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:16.746405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.806442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.807914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.817548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1327/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:16.827538 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439253f-1400-49b3-95a1-313267e5334d service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:16.833124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:16.833771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:16.834057 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:16.834334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:16.836174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:16.847964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:16.849617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:16.860558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1282/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:25:26.757406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:26.758969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:26.847639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fc86-a3fb-4a0c-995d-4a26be837e95 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:26.853015 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:26.853719 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:26.854001 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:26.854690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:26.856159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:26.856723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=35 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:26.869952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:26.871836 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463ff84-6b44-4a46-8c0b-c10e8f915b36 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:26.884109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1328/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:26.931499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:27.003454 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae6f35-295b-4d80-bd0b-6c3b1d078d0c service placement] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:27.008261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:27.009146 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:27.009417 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:27.009677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] PATH_INFO: `/v3/users/de34912c6ff6459d89146a17b51e02f7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:27.010873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de34912c6ff6459d89146a17b51e02f7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:27.012815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:27.215981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de34912c6ff6459d89146a17b51e02f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:27.229849 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de34912c6ff6459d89146a17b51e02f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:27.230717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de34912c6ff6459d89146a17b51e02f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:27.231557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de34912c6ff6459d89146a17b51e02f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:27.239341 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de34912c6ff6459d89146a17b51e02f7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:27.306990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1283/2611] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:26 2022] DELETE /identity/v3/users/de34912c6ff6459d89146a17b51e02f7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:27.312071 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:27.313126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:27.313126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:27.329933 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:27.331119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:27.352523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=100 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:27.389662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1329/2612] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:27.399145 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:27.400797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:27.466634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f654f-5362-4e27-be51-9b3853bf8351 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:27.470817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:27.471462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:27.471740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:27.472016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:27.481212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:27.482690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:27.492770 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1284/2613] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:27.969232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:27.970964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:27.988475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ad077-0017-42cd-9c8d-bed7717ad66f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:27.993282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:27.994204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:27.994481 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:27.994754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] PATH_INFO: `/v3/projects/b4515c6c40f34368a27e204aeedfc7f7` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:27.996070 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4515c6c40f34368a27e204aeedfc7f7)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:27.998000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:28.113014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4515c6c40f34368a27e204aeedfc7f7', 'request_id': 'req-2574b3ef-6884-4d05-ad1e-073930ee67b3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.194934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4515c6c40f34368a27e204aeedfc7f7', 'request_id': 'req-2574b3ef-6884-4d05-ad1e-073930ee67b3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.202628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4515c6c40f34368a27e204aeedfc7f7', 'request_id': 'req-2574b3ef-6884-4d05-ad1e-073930ee67b3'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.213539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] The token cache is being invalidate because project b4515c6c40f34368a27e204aeedfc7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:28.213854 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.214686 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.216362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1330/2614] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:27 2022] DELETE /identity/v3/projects/b4515c6c40f34368a27e204aeedfc7f7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:28.220321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:28.229944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d3819-c90a-4eb0-9aa7-274a798e8336 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:28.249570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:28.296680 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:28.297559 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:28.297835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:28.298107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] PATH_INFO: `/v3/users/d19eac3cbc2445d2b5f6a941dbe6b971` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:28.299292 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19eac3cbc2445d2b5f6a941dbe6b971)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:28.301278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:28.521532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19eac3cbc2445d2b5f6a941dbe6b971'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.534363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19eac3cbc2445d2b5f6a941dbe6b971'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.535105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19eac3cbc2445d2b5f6a941dbe6b971'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.535776 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19eac3cbc2445d2b5f6a941dbe6b971'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.543558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-25c32dfa-5379-462a-8bf8-00effffd6033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19eac3cbc2445d2b5f6a941dbe6b971'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:28.683386 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1285/2615] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:28 2022] DELETE /identity/v3/users/d19eac3cbc2445d2b5f6a941dbe6b971 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:29.280981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:29.282383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:29.297474 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b3ef-6884-4d05-ad1e-073930ee67b3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:29.356868 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:29.357419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:29.357699 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:29.357965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] PATH_INFO: `/v3/projects/b86f08602a9943a48634d5cade34b2c0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:29.359129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86f08602a9943a48634d5cade34b2c0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:29.361033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:29.486977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86f08602a9943a48634d5cade34b2c0', 'request_id': 'req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:29.491288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:29.575248 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86f08602a9943a48634d5cade34b2c0', 'request_id': 'req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:29.583620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86f08602a9943a48634d5cade34b2c0', 'request_id': 'req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:29.595414 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] The token cache is being invalidate because project b86f08602a9943a48634d5cade34b2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:29.595823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:29.596560 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-f66ddeea-13aa-4bbf-950e-c9f59b2a2b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:29.598344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1331/2616] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:29 2022] DELETE /identity/v3/projects/b86f08602a9943a48634d5cade34b2c0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:25:29.604168 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:29.604718 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:29.604847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:29.623117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:29.624818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:29.694997 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1286/2617] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:29.703165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:29.703453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:29.703759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:29.723813 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:29.725058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:29.733504 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1332/2618] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:29.737869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:29.748932 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c24f3-f233-4377-884e-db16d42f45e1 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:29.754033 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:29.761529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:29.770819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1287/2619] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:25:29.775095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:29.786523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0a8e0-761d-458d-8a0e-17789aa8e43b None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:29.792224 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:29.793513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:29.793820 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:29.794094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:29.794783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:29.796708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:29.926552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1333/2620] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:29 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:25:29.930577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:29.941590 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b89714-b2e4-4a14-b773-811aa1cee5ed admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:29.970148 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:30.001300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.001975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.002261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.002542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.003240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.005295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.107251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1288/2621] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:29 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:30.108133 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.119576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae63c-16d3-4dd1-a923-2e06c3a0b9a1 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.124285 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.125058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.125343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.125735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.126461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.128331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.140039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1334/2622] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:25:30.144172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.156123 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba88faf-7094-4141-aaac-ba8d632113c9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.160900 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.161561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.161836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.162105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.162815 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.164440 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e153b-e927-4e32-9020-65864524ea57 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.174547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1289/2623] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:30.182981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.189335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a089c-554e-4ed3-a288-c198d650f1d3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.194040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.194966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.195376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.195654 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] PATH_INFO: `/v3/projects/3018c66f95c84c2db199fdf477d64c92/users/4470ec9f032542ea81df58ab3fdde10e/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.211472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3018c66f95c84c2db199fdf477d64c92, user_id=4470ec9f032542ea81df58ab3fdde10e, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.222985 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.323290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1335/2624] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:30 2022] PUT /identity/v3/projects/3018c66f95c84c2db199fdf477d64c92/users/4470ec9f032542ea81df58ab3fdde10e/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:25:30.330226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.330515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.330793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.359257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] MFA Rules not processed for user `4470ec9f032542ea81df58ab3fdde10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:30.360506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:30.426655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1290/2625] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:30.431268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.495977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29bb4-07b4-400b-8f19-63493e3dc5ec admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.501827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.502636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.502922 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.503207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.503895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.505829 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.598251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1336/2626] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:30 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:30.599793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.610890 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e788-ada0-42f7-b04b-d36d1da8cbbe None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.669944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.671535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.671535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.671823 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.672593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.674557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.777783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1291/2627] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:30 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:30.781696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.794442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11217a5-16e5-43cb-88b6-47984b499718 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.800623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.801312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.801594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.801918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.802714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.804520 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.821223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1337/2628] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:30.825336 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.837782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26267f-7ef2-4192-b620-57f1e51edaa3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:30.845588 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:30.846513 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:30.846795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:30.847071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] PATH_INFO: `/v3/projects/02d31299ba0f46fb91507fcdff8c0191/users/2fe023612eed499a84f006ba53325fde/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:30.866358 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d31299ba0f46fb91507fcdff8c0191, user_id=2fe023612eed499a84f006ba53325fde, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:30.869439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:30.950668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1292/2629] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:30 2022] PUT /identity/v3/projects/02d31299ba0f46fb91507fcdff8c0191/users/2fe023612eed499a84f006ba53325fde/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:30.955237 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:30.966349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb94f1a-7602-4eef-b420-155657c48b01 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:31.021085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:31.033511 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:31.034453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:31.034599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:31.034768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:31.035500 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:31.037255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b45a-98a2-46c7-8862-1019143312b9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:31.056002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1338/2630] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:25:31.061904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:31.064377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:31.078447 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ce83-8e94-40d5-91fd-4f50b5ee08f8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:31.084067 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:31.085058 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:31.085407 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:31.085691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] PATH_INFO: `/v3/projects/02d31299ba0f46fb91507fcdff8c0191/users/2fe023612eed499a84f006ba53325fde/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:31.088008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d31299ba0f46fb91507fcdff8c0191, user_id=2fe023612eed499a84f006ba53325fde, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:31.093186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:31.102857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1293/2631] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:31 2022] PUT /identity/v3/projects/02d31299ba0f46fb91507fcdff8c0191/users/2fe023612eed499a84f006ba53325fde/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:31.119849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:31.120260 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:31.120846 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:31.152175 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] MFA Rules not processed for user `2fe023612eed499a84f006ba53325fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:31.153710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:31.230721 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1339/2632] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:31.244469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:31.246613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:31.311705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b4291-769c-41c9-a5d9-52fa47c4ac78 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:31.316744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:31.317448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:31.317915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:31.318331 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:31.341549 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:31.345243 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda5919-11b8-4687-90b0-cf610039db3d service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:31.356811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1294/2633] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:32.486886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:32.554080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfce81b-0a3e-42e0-956a-346dae46020c None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:32.558448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:32.559293 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:32.559565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:32.559828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] PATH_INFO: `/v3/users/4470ec9f032542ea81df58ab3fdde10e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:32.561618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4470ec9f032542ea81df58ab3fdde10e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:32.563502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:32.759745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4470ec9f032542ea81df58ab3fdde10e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:32.771562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4470ec9f032542ea81df58ab3fdde10e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:32.778363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4470ec9f032542ea81df58ab3fdde10e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:32.779056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4470ec9f032542ea81df58ab3fdde10e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:32.780226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4470ec9f032542ea81df58ab3fdde10e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:32.781919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:32.900482 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1340/2634] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:32 2022] DELETE /identity/v3/users/4470ec9f032542ea81df58ab3fdde10e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:32.904939 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:32.905429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:32.905536 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:32.926529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:32.927745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:32.985928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1295/2635] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:32.995555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:32.996982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:33.054928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d48b2b-2ff7-46d3-8407-ec2b409c7989 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:33.058667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:33.059536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:33.059661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:33.059966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:33.070029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:33.071522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:33.081641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1341/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:33.511308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:33.512769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:33.524863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e93f4-6da2-432f-a693-3f7bcb183f61 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:33.530869 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:33.531735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:33.537142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:33.537142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] PATH_INFO: `/v3/projects/3018c66f95c84c2db199fdf477d64c92` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:33.537142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3018c66f95c84c2db199fdf477d64c92)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:33.537142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:33.691044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3018c66f95c84c2db199fdf477d64c92', 'request_id': 'req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:33.769212 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3018c66f95c84c2db199fdf477d64c92', 'request_id': 'req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:33.775787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3018c66f95c84c2db199fdf477d64c92', 'request_id': 'req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:33.786178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] The token cache is being invalidate because project 3018c66f95c84c2db199fdf477d64c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:33.786461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:33.787095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:33.788829 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1296/2637] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:33 2022] DELETE /identity/v3/projects/3018c66f95c84c2db199fdf477d64c92 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:33.793080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:33.803546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c395-0505-4670-b71e-908de769887b service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:33.859766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:33.860677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:33.860962 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:33.861238 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] PATH_INFO: `/v3/users/2fe023612eed499a84f006ba53325fde` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:33.862404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe023612eed499a84f006ba53325fde)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:33.864330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:34.098021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe023612eed499a84f006ba53325fde'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.110851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe023612eed499a84f006ba53325fde'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.117677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe023612eed499a84f006ba53325fde'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.118357 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe023612eed499a84f006ba53325fde'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.118988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-fbec4103-06d2-43ce-a3ca-cc2d712ea817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe023612eed499a84f006ba53325fde'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.194581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1342/2638] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:33 2022] DELETE /identity/v3/users/2fe023612eed499a84f006ba53325fde => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:34.679482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:34.680985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:34.694418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5d22-5342-4bb4-a2e4-6b863c9f243a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:34.707876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:34.751817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:34.752706 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:34.752986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:34.753257 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] PATH_INFO: `/v3/projects/02d31299ba0f46fb91507fcdff8c0191` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:34.754413 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d31299ba0f46fb91507fcdff8c0191)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:34.756335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:34.878431 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d31299ba0f46fb91507fcdff8c0191', 'request_id': 'req-677855f3-8813-484b-a080-03dcba3bf163'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.980610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d31299ba0f46fb91507fcdff8c0191', 'request_id': 'req-677855f3-8813-484b-a080-03dcba3bf163'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.987346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d31299ba0f46fb91507fcdff8c0191', 'request_id': 'req-677855f3-8813-484b-a080-03dcba3bf163'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.997611 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] The token cache is being invalidate because project 02d31299ba0f46fb91507fcdff8c0191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:34.997893 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:34.999016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-677855f3-8813-484b-a080-03dcba3bf163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:35.000607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1297/2639] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:34 2022] DELETE /identity/v3/projects/02d31299ba0f46fb91507fcdff8c0191 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:35.005562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.005999 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.006304 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.024460 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:35.025696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:35.034316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:35.086222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1343/2640] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:35.094676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.094966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.095245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.113599 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:35.114842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:35.122872 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1298/2641] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:35.127586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.137354 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33c880-eddb-4d16-88b8-491f10324f82 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.142592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.143279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.143549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.143834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.144639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:25:35.144951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.146559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.159388 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1344/2642] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:25:35.162895 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.172943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813c404-6484-4e74-80d4-4d3b2918c4ca None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.177682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.178330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.178633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.179188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.179702 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.181562 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.270119 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1299/2643] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:35.274183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.284386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882df3f-3267-4c3a-ba38-5187250878e4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.345347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.346020 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.346359 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.346635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.347370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.349425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.452099 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1345/2644] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:35.456514 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.466575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da43d3e-bedd-426b-b8b4-1905934c3250 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.471901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.472581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.472862 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.473138 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.473966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.475576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.486636 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1300/2645] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:25:35.490583 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.501276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af594d-b3ee-489f-9910-4c4e2e7c5b30 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.505849 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.506506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.506789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.507064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.507776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.509401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5087-485f-4435-ba96-d1f207fd1a46 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.519473 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1346/2646] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:35.523731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.534075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358654-bb4e-44fd-b695-8044739db4f9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.538607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.539495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.539777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.540053 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] PATH_INFO: `/v3/projects/4b4aab27a15e4250a7b6c4c5b3980f91/users/6b866ff7e1f1474698decdde72680de1/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.556077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4aab27a15e4250a7b6c4c5b3980f91, user_id=6b866ff7e1f1474698decdde72680de1, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.558777 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:35.775343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1301/2647] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:35 2022] PUT /identity/v3/projects/4b4aab27a15e4250a7b6c4c5b3980f91/users/6b866ff7e1f1474698decdde72680de1/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:35.792811 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.793095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.793368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.821342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] MFA Rules not processed for user `6b866ff7e1f1474698decdde72680de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:35.822554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:35.887869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1347/2648] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:35.892388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:35.937506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:35.955339 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750d4a-acc6-4215-b6d4-085f14f81629 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:35.960011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:35.960765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:35.961047 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:35.961346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:35.962065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:35.964056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.102682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1302/2649] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:35 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:36.106667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.117555 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea1a1f-e974-48b8-9529-f680a089fe59 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.122331 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:36.173075 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.173736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.174012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.174278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.174956 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.176979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.341134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1348/2650] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:36 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:36.345207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.355526 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc82a9-2eaf-4732-bd1c-862e48dd64dc admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.360065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.360762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.361044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.361316 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.362024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.363649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.374486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1303/2651] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:36.378556 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.389915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140d4b4-16bd-49d2-8389-0290f9a7d2df admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.394674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.395548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.395828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.396104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] PATH_INFO: `/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3/users/86614d93887d4c7d848273a245b1ce0e/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.410485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba6a6c98a7a457488a6767a0ed2e1b3, user_id=86614d93887d4c7d848273a245b1ce0e, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.413155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.511623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1349/2652] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:36 2022] PUT /identity/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3/users/86614d93887d4c7d848273a245b1ce0e/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:25:36.516498 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.526409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14ad5-71e7-49d4-88ad-ed58a0ab9a99 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.581712 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.582364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.582640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.582908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.583607 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.585274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1642847-16c8-4ee5-849e-8e0adf62512e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.595944 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1304/2653] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:36.599554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.610144 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5005-c71a-4816-a350-d4a7c280f727 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.614417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.615288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.615570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.615845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] PATH_INFO: `/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3/users/86614d93887d4c7d848273a245b1ce0e/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.617859 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba6a6c98a7a457488a6767a0ed2e1b3, user_id=86614d93887d4c7d848273a245b1ce0e, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.620498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.631210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1350/2654] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:36 2022] PUT /identity/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3/users/86614d93887d4c7d848273a245b1ce0e/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:36.643293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.643585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.643867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.670940 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] MFA Rules not processed for user `86614d93887d4c7d848273a245b1ce0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:36.672169 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:36.740060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1305/2655] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:36.751969 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:36.753677 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:36.808966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc347-87be-4180-8061-372097bea73a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:36.813372 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:36.814034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:36.814316 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:36.814584 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:36.823769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:36.825483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:36.835351 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1351/2656] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:37.133639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:37.143333 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc690a5-e2c1-41fc-8758-a0b3c20433b3 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:37.146892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:37.147581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:37.147870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:37.148143 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:37.181622 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:37.204308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:37.206040 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca077d9-d891-42f6-9a6e-eb047656f96c service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:37.214846 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1306/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:46.537249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:46.600157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfda3d-19da-4622-a826-6492b4b0da41 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:46.604663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:46.605516 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:46.605786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:46.606055 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] PATH_INFO: `/v3/users/6b866ff7e1f1474698decdde72680de1` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:46.607223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b866ff7e1f1474698decdde72680de1)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:46.609150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:46.613582 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:46.921718 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b866ff7e1f1474698decdde72680de1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:46.934128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b866ff7e1f1474698decdde72680de1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:46.941425 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b866ff7e1f1474698decdde72680de1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:46.942145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b866ff7e1f1474698decdde72680de1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:46.942782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b866ff7e1f1474698decdde72680de1'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:47.054777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1352/2658] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:46 2022] DELETE /identity/v3/users/6b866ff7e1f1474698decdde72680de1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:47.059480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:47.059971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:47.060591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:47.077909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:47.079083 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:47.140020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1307/2659] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:47.149665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:47.151086 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:47.209084 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d108-f571-40e1-ad05-09cddd560f8a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:47.212495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:47.213128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:47.213404 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:47.213671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:47.223107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:47.224550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:47.233895 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1353/2660] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:47.762380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:47.764736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:47.778656 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1156c91-e9aa-4d42-b7c2-f02e8ed5b6b6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:47.786313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:47.787408 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:47.788887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:47.789359 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] PATH_INFO: `/v3/projects/4b4aab27a15e4250a7b6c4c5b3980f91` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:47.790765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4aab27a15e4250a7b6c4c5b3980f91)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:47.792867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:47.970738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4aab27a15e4250a7b6c4c5b3980f91', 'request_id': 'req-335fd330-37fa-4893-8f01-56fe4f1890e0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.103679 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4aab27a15e4250a7b6c4c5b3980f91', 'request_id': 'req-335fd330-37fa-4893-8f01-56fe4f1890e0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.110540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4aab27a15e4250a7b6c4c5b3980f91', 'request_id': 'req-335fd330-37fa-4893-8f01-56fe4f1890e0'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.121008 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] The token cache is being invalidate because project 4b4aab27a15e4250a7b6c4c5b3980f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:48.121297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.121938 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.123994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1308/2661] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:47 2022] DELETE /identity/v3/projects/4b4aab27a15e4250a7b6c4c5b3980f91 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:48.127998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:48.137476 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c83e8-9602-42f9-9601-3851b8351b30 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:48.191903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:48.192808 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:48.193080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:48.193344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] PATH_INFO: `/v3/users/86614d93887d4c7d848273a245b1ce0e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:48.194552 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86614d93887d4c7d848273a245b1ce0e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:48.196495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:48.333875 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:48.522665 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86614d93887d4c7d848273a245b1ce0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.534775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86614d93887d4c7d848273a245b1ce0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.541452 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86614d93887d4c7d848273a245b1ce0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.542129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86614d93887d4c7d848273a245b1ce0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.542735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c35ce81b-e7d6-4311-bec2-485d3a4805f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86614d93887d4c7d848273a245b1ce0e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:48.697370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1354/2662] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:48 2022] DELETE /identity/v3/users/86614d93887d4c7d848273a245b1ce0e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:49.213756 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:49.215216 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:49.228007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd330-37fa-4893-8f01-56fe4f1890e0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:49.288947 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:49.289802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.290124 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.290405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] PATH_INFO: `/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.291583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba6a6c98a7a457488a6767a0ed2e1b3)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:49.297442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:49.297442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:49.475075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba6a6c98a7a457488a6767a0ed2e1b3', 'request_id': 'req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:49.571552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba6a6c98a7a457488a6767a0ed2e1b3', 'request_id': 'req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:49.578075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba6a6c98a7a457488a6767a0ed2e1b3', 'request_id': 'req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:49.589373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] The token cache is being invalidate because project 9ba6a6c98a7a457488a6767a0ed2e1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:49.589651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:49.590330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-3dde1b17-bd99-4f9d-afa1-1c90d9dd9760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:49.592474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1309/2663] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:49 2022] DELETE /identity/v3/projects/9ba6a6c98a7a457488a6767a0ed2e1b3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:49.597524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.597994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.598131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.616847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:49.618028 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:49.675629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1355/2664] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:49.683231 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.683517 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.683789 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.703904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:49.705381 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:49.713060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1310/2665] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:49.717097 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:49.726643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb2f24-c2a7-49b6-af24-ad26f0f8d7b6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:49.731060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:49.731701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.732005 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.732310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.733018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:25:49.733320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:49.734886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:49.746195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1356/2666] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:25:49.750759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:49.760380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86168-6433-4a8e-92ed-8b9a58765db7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:49.765617 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:49.766258 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.766532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.766797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.767481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:49.769409 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:49.910192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1311/2667] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:49 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:49.914349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:49.924886 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64eeb-0cd2-4a66-b538-b72ad926c1c9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:49.979965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:49.980664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:49.980944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:49.981215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:49.982400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:49.984380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.137462 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1357/2668] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:49 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:25:50.142078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.152109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14117c80-ac56-4b23-abeb-d0a589ad28e1 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.157099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.157749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.158029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.158295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.159006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.165585 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.171017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1312/2669] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:50.174993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.185230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2b4f-8d0f-48c4-aa7c-79dafb38708b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.190054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.190739 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.191022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.191299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.192013 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.193720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f862a2-c098-4382-b928-c8631f7e7585 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.204347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1358/2670] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:50.213382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.223832 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77847-2225-47cc-81a5-e4337ec12750 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.228347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.229203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.229477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.229746 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] PATH_INFO: `/v3/projects/b9c16be769d543c8bf7c079daf5b1f76/users/3e58ac6069ae4770a7461d50282a4898/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.243817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c16be769d543c8bf7c079daf5b1f76, user_id=3e58ac6069ae4770a7461d50282a4898, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.246463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.332710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1313/2671] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:50 2022] PUT /identity/v3/projects/b9c16be769d543c8bf7c079daf5b1f76/users/3e58ac6069ae4770a7461d50282a4898/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:50.345327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.345610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.345883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.365507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:50.373063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] MFA Rules not processed for user `3e58ac6069ae4770a7461d50282a4898`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:50.374275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:50.438531 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1359/2672] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:50.442993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.505875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4605d-8d08-423d-96d8-d654e992eeb6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.510521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.511196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.511479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.511757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.512579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.514691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.625078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1314/2673] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:25:50 2022] POST /identity/v3/projects => generated 401 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:50.629225 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.639912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99014567-862e-4de2-8ac8-9003287c03ed None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.695312 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.695891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.696173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.696475 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.697199 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.699105 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.803083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1360/2674] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:25:50 2022] POST /identity/v3/users => generated 307 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:25:50.807217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.817543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f45e0-72ff-4f5e-9352-06fb2db93001 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.822153 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.822804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.823111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.823382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.824091 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.826210 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.831672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:50.837949 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1315/2675] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:25:50.842835 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.852840 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099f0e-52b5-45f3-b46c-9b5cf940cc0f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:50.857421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:50.858297 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:50.858574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:50.858893 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] PATH_INFO: `/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca/users/fc7778c80e9546098adf3fd90597f029/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:50.873648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8fe508a1cd47a2bf82bdf057b635ca, user_id=fc7778c80e9546098adf3fd90597f029, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:50.876306 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:50.966885 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1361/2676] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:50 2022] PUT /identity/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca/users/fc7778c80e9546098adf3fd90597f029/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:25:50.970665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:50.980571 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7062d-219a-41ad-a6ac-ed198aadb459 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:51.036334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:51.036995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:51.037272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:51.037541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:51.038251 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:51.039894 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffcfc-5f16-46e2-b09a-b6e61d2a0e1f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:51.049460 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1316/2677] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:25:51.053580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:51.064419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2dd5-3d6c-4e8c-9e2e-7f37c0d91896 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:51.068965 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:51.069832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:51.070112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:51.070383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] PATH_INFO: `/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca/users/fc7778c80e9546098adf3fd90597f029/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:51.072618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8fe508a1cd47a2bf82bdf057b635ca, user_id=fc7778c80e9546098adf3fd90597f029, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:51.074960 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:51.086547 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1362/2678] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:25:51 2022] PUT /identity/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca/users/fc7778c80e9546098adf3fd90597f029/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:51.100734 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:51.101019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:51.101293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:51.129281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] MFA Rules not processed for user `fc7778c80e9546098adf3fd90597f029`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:51.130476 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:51.197521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1317/2679] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:25:51.209750 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:51.211422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:51.268241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcaaae-793a-4162-a0ed-013a1691862a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:51.271688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:51.272356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:51.272639 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:51.272907 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:51.279765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:51.282082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:51.283480 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:51.293010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1363/2680] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:51.789172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:51.798719 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238233-779f-4aa6-821c-61a6f47b0854 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:51.802246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:51.802873 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:51.803152 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:51.803418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:51.859743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:51.861149 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d65f0-9ee1-4b81-a9e5-a167ea112658 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:51.869901 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1318/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:57.682674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:57.750035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1944-e715-442f-b6f7-bc50981f9ab2 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:57.755045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:57.755964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:57.756276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:57.756554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] PATH_INFO: `/v3/users/3e58ac6069ae4770a7461d50282a4898` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:57.757775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e58ac6069ae4770a7461d50282a4898)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:57.759793 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:58.024692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e58ac6069ae4770a7461d50282a4898'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:58.037408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e58ac6069ae4770a7461d50282a4898'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:58.044889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e58ac6069ae4770a7461d50282a4898'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:58.045581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e58ac6069ae4770a7461d50282a4898'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:58.046172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e58ac6069ae4770a7461d50282a4898'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:58.172187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1364/2682] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:57 2022] DELETE /identity/v3/users/3e58ac6069ae4770a7461d50282a4898 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:58.176828 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:58.177300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:58.177402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:58.194030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:25:58.195319 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:58.208352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=100 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:58.254572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1319/2683] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:25:58.264908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:58.266333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:58.322997 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbafbf3-9aff-4b11-a4c1-a032acbeb670 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:58.327143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:58.327786 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:58.328067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:58.328371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:58.337827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:58.339240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:58.349611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1365/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:58.816241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:58.817787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:25:58.832676 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f46b6-a7b1-4abd-95f0-73b288e22700 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:58.837677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:58.838548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:58.838834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:58.839330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] PATH_INFO: `/v3/projects/b9c16be769d543c8bf7c079daf5b1f76` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:58.840542 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c16be769d543c8bf7c079daf5b1f76)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:58.843131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:58.986239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c16be769d543c8bf7c079daf5b1f76', 'request_id': 'req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.100582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c16be769d543c8bf7c079daf5b1f76', 'request_id': 'req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.108418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c16be769d543c8bf7c079daf5b1f76', 'request_id': 'req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.119166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] The token cache is being invalidate because project b9c16be769d543c8bf7c079daf5b1f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:25:59.119452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.120095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.121659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1320/2685] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:25:58 2022] DELETE /identity/v3/projects/b9c16be769d543c8bf7c079daf5b1f76 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:25:59.126333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:25:59.136288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef608a6-9098-4fb9-838b-8334b97ba805 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:25:59.148613 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:59.192658 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:25:59.193577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:25:59.194784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:25:59.194784 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] PATH_INFO: `/v3/users/fc7778c80e9546098adf3fd90597f029` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:25:59.195284 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7778c80e9546098adf3fd90597f029)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:25:59.197215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:25:59.431200 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7778c80e9546098adf3fd90597f029'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.443479 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7778c80e9546098adf3fd90597f029'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.450360 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7778c80e9546098adf3fd90597f029'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.451038 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7778c80e9546098adf3fd90597f029'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.451636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-0559a285-67f7-454c-abb8-d13ad4d7ef67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7778c80e9546098adf3fd90597f029'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:25:59.572010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1366/2686] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:25:59 2022] DELETE /identity/v3/users/fc7778c80e9546098adf3fd90597f029 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:00.018858 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.023242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:00.034852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1bad-d60e-4ead-91a1-8d2a2624dbdf admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.094007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.094889 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.095179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.095450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] PATH_INFO: `/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.096707 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8fe508a1cd47a2bf82bdf057b635ca)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.098684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.235392 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:00.238167 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8fe508a1cd47a2bf82bdf057b635ca', 'request_id': 'req-f185b671-29dc-4955-9919-fdc3c90cfbd7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:00.317696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8fe508a1cd47a2bf82bdf057b635ca', 'request_id': 'req-f185b671-29dc-4955-9919-fdc3c90cfbd7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:00.324531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8fe508a1cd47a2bf82bdf057b635ca', 'request_id': 'req-f185b671-29dc-4955-9919-fdc3c90cfbd7'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:00.336796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] The token cache is being invalidate because project ab8fe508a1cd47a2bf82bdf057b635ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:00.337079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:00.337740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f185b671-29dc-4955-9919-fdc3c90cfbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:00.343415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1321/2687] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:26:00 2022] DELETE /identity/v3/projects/ab8fe508a1cd47a2bf82bdf057b635ca => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:26:00.345010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.345395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.345563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.363708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:00.364940 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:00.426276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1367/2688] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:00.434245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.434527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.434801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.453093 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:00.454293 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:00.462278 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1322/2689] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:00.467444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.477418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb6d6b-599e-4273-8329-c277063d6027 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.482059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.482715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.482996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.483269 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.484010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:26:00.484378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.485964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.497544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1368/2690] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:26:00.502444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.511749 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5c00-9bfb-4ad0-924b-2d7d68cc50b8 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.516850 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.517490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.517771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.518045 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.518764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.520743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.615697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1323/2691] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:26:00 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:00.619881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.630124 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99224-0244-48ff-95d5-4751524c8093 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.650943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:00.687778 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.688485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.688765 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.689034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.689732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.691983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.833546 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1369/2692] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:26:00 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:00.837745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.848269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a619f-0909-405c-9a9f-5de95a36b745 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.852769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.853423 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.853695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.853964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.854673 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.856271 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.866465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1324/2693] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:00.870362 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.881562 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989221f5-c084-40e6-8fbb-72bba44641b8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.886201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.886878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.887166 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.887449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.888844 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.890431 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be8330-4d5d-4481-9550-7b2ed3aceb28 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:00.900682 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1370/2694] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:00.904705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:00.914842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf75d3-e019-4a19-b723-239caa8c60d7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:00.919396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:00.920277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:00.920555 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:00.920819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] PATH_INFO: `/v3/projects/b55e715d951c438fab287505aab5f254/users/e455fe397e9c42ec939e44025ee01e97/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:00.935209 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55e715d951c438fab287505aab5f254, user_id=e455fe397e9c42ec939e44025ee01e97, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:00.937838 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.023303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1325/2695] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:00 2022] PUT /identity/v3/projects/b55e715d951c438fab287505aab5f254/users/e455fe397e9c42ec939e44025ee01e97/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:01.034418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.034710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.034987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.063045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] MFA Rules not processed for user `e455fe397e9c42ec939e44025ee01e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:01.067909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:01.129159 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1371/2696] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:01.133677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.195354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225519bc-9c3d-4821-9c79-a8043cc3801e admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.200015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.200713 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.200987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.201256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.201936 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.203817 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.287068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1326/2697] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:26:01 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:01.291057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.302119 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903ea7c-5c52-4bae-998f-845650199c14 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.360417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.371523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.371523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.371523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.371523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.371523 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.549210 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1372/2698] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:26:01 2022] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:01.553402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.564221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33949ce-8bb8-40ec-99ef-1fba207d5b36 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.569014 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.569669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.569957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.570286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.570972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.572837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.584455 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1327/2699] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:01.588623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.598743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6c2e-a0d2-418d-b917-801e9164ac15 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.603681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.604588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.604865 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.605132 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] PATH_INFO: `/v3/projects/ffc1a6b845444958897cf87651f2e6f9/users/fefeb98babe142edb67f6de94f800b2a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.619715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc1a6b845444958897cf87651f2e6f9, user_id=fefeb98babe142edb67f6de94f800b2a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.623330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.726669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:01.732436 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1373/2700] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:01 2022] PUT /identity/v3/projects/ffc1a6b845444958897cf87651f2e6f9/users/fefeb98babe142edb67f6de94f800b2a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:01.736477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.746563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4f76-52a8-438c-b348-38eb265e7d07 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.788728 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:01.803560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.804166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.804479 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.804755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.805474 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.807081 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760a4f-2ed3-434a-869d-b0d5d9f57f54 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.819945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1328/2701] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:01.824464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.835929 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafab0d-3ef8-4dec-b430-473069b529a2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:01.840607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:01.841501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.841782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.842054 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] PATH_INFO: `/v3/projects/ffc1a6b845444958897cf87651f2e6f9/users/fefeb98babe142edb67f6de94f800b2a/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.843989 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc1a6b845444958897cf87651f2e6f9, user_id=fefeb98babe142edb67f6de94f800b2a, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:01.846674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:01.857104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1374/2702] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:01 2022] PUT /identity/v3/projects/ffc1a6b845444958897cf87651f2e6f9/users/fefeb98babe142edb67f6de94f800b2a/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:01.869708 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:01.869999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:01.870277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:01.898730 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] MFA Rules not processed for user `fefeb98babe142edb67f6de94f800b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:01.901184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:01.966711 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1329/2703] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:01.977418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:01.979198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:02.037403 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff963a9-9ef9-475c-8db8-c79b8150c80c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:02.041059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:02.041696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:02.041971 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:02.042282 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:02.051896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:02.053352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e35f-5f9d-44a5-8b90-18c98f4d5467 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:02.063123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1375/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:02.195793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:02.262437 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb91b-3379-4e1c-90f8-cca876b4412b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:02.266915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:02.267772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:02.268049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:02.268350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] PATH_INFO: `/v3/users/e455fe397e9c42ec939e44025ee01e97` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:02.269507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e455fe397e9c42ec939e44025ee01e97)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:02.271610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:02.509009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e455fe397e9c42ec939e44025ee01e97'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:02.522867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e455fe397e9c42ec939e44025ee01e97'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:02.523535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e455fe397e9c42ec939e44025ee01e97'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:02.524188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e455fe397e9c42ec939e44025ee01e97'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:02.526295 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:02.531827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e455fe397e9c42ec939e44025ee01e97'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:02.674674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1330/2705] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:26:02 2022] DELETE /identity/v3/users/e455fe397e9c42ec939e44025ee01e97 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:26:02.679112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:02.679605 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:02.679712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:02.698295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:02.699505 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:02.761807 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1376/2706] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:02.771363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:02.772851 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:02.832391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7eae5-7d79-49e9-baad-44200d51799b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:02.836774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:02.837424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:02.837705 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:02.837983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:02.849966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:02.851448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:02.861882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1331/2707] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:03.289970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:03.294891 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:03.305705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c6857-a5af-4dc5-b6b7-e184c28f3a90 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:03.310701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:03.311566 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:03.311843 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:03.312118 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] PATH_INFO: `/v3/projects/b55e715d951c438fab287505aab5f254` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:03.313559 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55e715d951c438fab287505aab5f254)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:03.315517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:03.457655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55e715d951c438fab287505aab5f254', 'request_id': 'req-88fedef7-f53d-4230-b308-ab4f77dbbb13'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:03.606298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55e715d951c438fab287505aab5f254', 'request_id': 'req-88fedef7-f53d-4230-b308-ab4f77dbbb13'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:03.613112 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55e715d951c438fab287505aab5f254', 'request_id': 'req-88fedef7-f53d-4230-b308-ab4f77dbbb13'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:03.623448 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] The token cache is being invalidate because project b55e715d951c438fab287505aab5f254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:03.623869 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:03.624501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:03.626044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1377/2708] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:26:03 2022] DELETE /identity/v3/projects/b55e715d951c438fab287505aab5f254 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:03.629990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:03.640041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8c7f-8ead-4b67-98b4-0b2753ab4217 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:03.695505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:03.696471 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:03.696751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:03.697035 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] PATH_INFO: `/v3/users/fefeb98babe142edb67f6de94f800b2a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:03.698184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefeb98babe142edb67f6de94f800b2a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:03.700645 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:04.039769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefeb98babe142edb67f6de94f800b2a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:04.052600 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefeb98babe142edb67f6de94f800b2a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:04.053279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefeb98babe142edb67f6de94f800b2a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:04.053880 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefeb98babe142edb67f6de94f800b2a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:04.060697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9aca3012-639b-4193-8d0a-206853755f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefeb98babe142edb67f6de94f800b2a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:04.180015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1332/2709] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:26:03 2022] DELETE /identity/v3/users/fefeb98babe142edb67f6de94f800b2a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:04.841596 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:04.843135 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:04.857620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedef7-f53d-4230-b308-ab4f77dbbb13 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:04.865937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:04.918534 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:04.923934 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:04.924258 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:04.924527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] PATH_INFO: `/v3/projects/ffc1a6b845444958897cf87651f2e6f9` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:04.925705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc1a6b845444958897cf87651f2e6f9)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:04.927589 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.080598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc1a6b845444958897cf87651f2e6f9', 'request_id': 'req-186f02db-b723-4279-b804-a8db97ebc981'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:05.174246 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc1a6b845444958897cf87651f2e6f9', 'request_id': 'req-186f02db-b723-4279-b804-a8db97ebc981'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:05.181291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc1a6b845444958897cf87651f2e6f9', 'request_id': 'req-186f02db-b723-4279-b804-a8db97ebc981'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:05.191424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] The token cache is being invalidate because project ffc1a6b845444958897cf87651f2e6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:05.191707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:05.192368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-186f02db-b723-4279-b804-a8db97ebc981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:05.194050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1378/2710] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:26:04 2022] DELETE /identity/v3/projects/ffc1a6b845444958897cf87651f2e6f9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:05.198852 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.199309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.199403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.212380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:05.218974 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:05.220155 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:05.279259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1333/2711] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:05.287290 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.287575 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.287848 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.306816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:05.308093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:05.316373 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1379/2712] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:05.320527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.331343 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c1333-5a03-4b77-aded-7e8faaee767a None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.336633 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.337448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.337727 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.338002 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.338721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:26:05.339020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.340775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.352774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1334/2713] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:26:05.357514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.366977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bed14-a10e-498c-8c6a-48c2888e5217 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.372433 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.378847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.378847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.378847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.378847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.378847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.507060 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1380/2714] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:26:05 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:05.511297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.522405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776778-c0f7-4a87-82b5-7c908736ca64 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.578642 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.579313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.579859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.580134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.580856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.582771 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.699981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1335/2715] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:26:05 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:26:05.704222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.714920 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6e0e-f64e-4c4d-938b-122b9d59fb1b admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.719430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.722529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.722529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.722529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.722529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.722972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.733623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1381/2716] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:05.737601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.748591 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57218fc-0e71-4376-963f-a868d794dd2d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.753568 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.754259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.754540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.754812 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.755520 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.757196 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c2aaf-0add-496c-8998-97fdf21fd62b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.766923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1336/2717] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:05.770883 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:05.781002 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458ad0-7482-4927-b59f-a1bd60dfb2ef admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:05.785551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:05.786420 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.786698 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.786968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] PATH_INFO: `/v3/projects/6380e58209c241de915583d03f2615ad/users/b9240f01fbd54243a6a5c1714e176884/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.802574 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6380e58209c241de915583d03f2615ad, user_id=b9240f01fbd54243a6a5c1714e176884, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:05.805234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:05.935795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1382/2718] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:05 2022] PUT /identity/v3/projects/6380e58209c241de915583d03f2615ad/users/b9240f01fbd54243a6a5c1714e176884/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:05.940991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5cf4-63a1-45ce-88be-0c1dad2e0092 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:05.941281 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5cf4-63a1-45ce-88be-0c1dad2e0092 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:05.941560 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5cf4-63a1-45ce-88be-0c1dad2e0092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:05.962593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-919f5cf4-63a1-45ce-88be-0c1dad2e0092 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:05.963819 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-919f5cf4-63a1-45ce-88be-0c1dad2e0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:06.024222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1337/2719] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:06.034196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:06.036083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:06.078233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:06.094021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a57d-81a4-41be-be72-ebbdae5f54cf admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:06.097632 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:06.098274 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:06.098561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:06.098837 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:06.108341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:06.109759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:06.119416 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1383/2720] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:07.585041 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:07.585580 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:07.585699 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:07.612501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:07.615765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] MFA Rules not processed for user `b9240f01fbd54243a6a5c1714e176884`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:07.617195 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:07.683135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1338/2721] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:07.688296 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:07.698278 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5d47-0161-48fd-a418-32fe190ea536 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:07.703570 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:07.704245 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:07.708694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:07.708694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:07.708694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:07.708694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:07.807952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1384/2722] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:26:07 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:07.812402 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:07.823674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90528e-61fa-4ebd-ad5c-9ccf07996b04 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:07.881125 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:07.881720 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:07.882001 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:07.882277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:07.882966 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:07.884991 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:08.029628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1339/2723] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:26:07 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:08.033612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:08.044216 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263d11-90ad-4583-ba01-238e6b50146f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:08.048756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:08.049409 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:08.049687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:08.049954 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:08.050659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:08.052254 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:08.062822 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1385/2724] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:08.068338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:08.078841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19c5d-e128-4784-a66f-2cab4084edd0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:08.086495 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:08.087905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:08.088368 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:08.088811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] PATH_INFO: `/v3/projects/a575c23986eb4df7ae5436a92f20d34a/users/d8725ce13f3e45018656a4c9d16b29bf/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:08.105844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a575c23986eb4df7ae5436a92f20d34a, user_id=d8725ce13f3e45018656a4c9d16b29bf, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:08.108573 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:08.237166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1340/2725] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:08 2022] PUT /identity/v3/projects/a575c23986eb4df7ae5436a92f20d34a/users/d8725ce13f3e45018656a4c9d16b29bf/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:08.241333 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:08.251744 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7eb0a-91fe-4f40-9d02-d2a79afab448 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:08.307864 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:08.311536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:08.311536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:08.311536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:08.311536 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:08.311914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8d584-b987-4a9c-bd5c-7ebab6f26638 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:08.321780 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1386/2726] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:08.326793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:08.337810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc5e45-1021-4c4a-bc29-161a07a1f221 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:08.342695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:08.343570 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:08.343847 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:08.344296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] PATH_INFO: `/v3/projects/a575c23986eb4df7ae5436a92f20d34a/users/d8725ce13f3e45018656a4c9d16b29bf/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:08.346279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a575c23986eb4df7ae5436a92f20d34a, user_id=d8725ce13f3e45018656a4c9d16b29bf, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:08.348971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68b17-1041-43f7-8196-a6197ef7e6de admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:08.359424 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1341/2727] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:26:08 2022] PUT /identity/v3/projects/a575c23986eb4df7ae5436a92f20d34a/users/d8725ce13f3e45018656a4c9d16b29bf/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:09.937554 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:09.938047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:09.938047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:09.966387 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] MFA Rules not processed for user `d8725ce13f3e45018656a4c9d16b29bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:09.967652 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:10.044673 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1387/2728] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:10.110121 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0942d3-e2b4-4235-af6b-5cc9f5c33bb2 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:10.110693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0942d3-e2b4-4235-af6b-5cc9f5c33bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:10.110693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0942d3-e2b4-4235-af6b-5cc9f5c33bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:10.128389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-bb0942d3-e2b4-4235-af6b-5cc9f5c33bb2 None None] MFA Rules not processed for user `b9240f01fbd54243a6a5c1714e176884`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:10.129604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-bb0942d3-e2b4-4235-af6b-5cc9f5c33bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:10.183592 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:10.192540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1342/2729] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:10.206205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:10.207602 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:10.244157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:10.290826 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175651f-d66c-472b-be6d-15eb75f69a51 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:10.295459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:10.296116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:10.296432 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:10.296705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:10.304878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:10.307337 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:10.315513 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1388/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:20.430821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=21 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:23.729841 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:23.730859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:23.730957 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:23.749383 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:23.750577 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:23.805261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1343/2731] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:26:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:23.972368 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:23.973834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:24.043816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f18443-a534-4a5a-ba03-24943767745f service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:24.048952 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:24.049598 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:24.049890 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:24.050156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:24.058107 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:24.060142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:24.068255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1389/2732] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:26:27.970135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:27.971643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:28.065472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3055-fe88-4568-9147-f91c566311a6 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:28.068986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:28.069918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:28.070306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:28.070576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:28.081963 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:28.084116 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2c37e-01e2-41bb-a054-81f46f867d98 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:28.095182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1344/2733] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:34.065117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=32 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:38.091022 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=51 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:41.001732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:41.003310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:41.066585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a8c7-e272-4fb5-b7ce-b439df5522ef service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:41.070172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:41.070817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.071101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.071402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.073790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:41.083783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:41.085233 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6d75b-d5ae-41c6-ab8a-96bf2774d54e service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:41.094120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1390/2734] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:41.502104 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.507313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.507313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.507313 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1345/2735] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:26:41.510910 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edeb2-66b4-4c8f-9427-33b016932b57 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.511205 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edeb2-66b4-4c8f-9427-33b016932b57 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.511501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edeb2-66b4-4c8f-9427-33b016932b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.531777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3d5edeb2-66b4-4c8f-9427-33b016932b57 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:41.533088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3d5edeb2-66b4-4c8f-9427-33b016932b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:41.548392 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1391/2736] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:41.569244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:41.571117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:41.635382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5cea6-a969-4e84-99fa-8d9197027928 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:41.639177 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:41.639941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.640350 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.640726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.652433 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:41.653941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad89de-e98a-4a0e-baf3-513f3058134d service glance] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:41.669180 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1346/2737] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:26:41.897759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8bf84-a3e7-4d79-8e1d-7da113113ea8 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.897970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8bf84-a3e7-4d79-8e1d-7da113113ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.898223 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8bf84-a3e7-4d79-8e1d-7da113113ea8 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.899779 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1392/2738] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:26:41.906066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd776e7-97f5-43fa-bf4c-2ff9a9b1e6d0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.906349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd776e7-97f5-43fa-bf4c-2ff9a9b1e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.906644 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd776e7-97f5-43fa-bf4c-2ff9a9b1e6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.924534 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-abd776e7-97f5-43fa-bf4c-2ff9a9b1e6d0 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:41.925710 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-abd776e7-97f5-43fa-bf4c-2ff9a9b1e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:41.932010 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1347/2739] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:41.943512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8bf84-a3e7-4d79-8e1d-7da113113ea8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:41.955633 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8bf84-a3e7-4d79-8e1d-7da113113ea8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:41.959207 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:41.959839 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:41.960123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:41.960421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:41.968374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:41.969791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8b347-e09b-4d66-b7a9-87970628789f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:41.978616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1393/2740] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:42.062794 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfded02-fac5-4496-b6f9-3648a87208ad None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:42.063107 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfded02-fac5-4496-b6f9-3648a87208ad None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:42.063382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfded02-fac5-4496-b6f9-3648a87208ad None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:42.064867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1348/2741] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:26:42.069978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d98-48f1-4f42-a441-199ad8c42895 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:42.070467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d98-48f1-4f42-a441-199ad8c42895 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:42.070568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d98-48f1-4f42-a441-199ad8c42895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:42.089607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-12b65d98-48f1-4f42-a441-199ad8c42895 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:42.090795 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-12b65d98-48f1-4f42-a441-199ad8c42895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:42.100082 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1394/2742] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:42.110282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfded02-fac5-4496-b6f9-3648a87208ad None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:42.121735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfded02-fac5-4496-b6f9-3648a87208ad None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:42.125323 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:42.125956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:42.126233 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:42.126501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:42.137111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:42.138582 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b52b4-a212-4daa-8377-54709a5f954d service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:42.149964 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1349/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:45.865131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aceec-52cd-44af-850b-074c4785dd44 None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:45.865708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aceec-52cd-44af-850b-074c4785dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:45.865708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aceec-52cd-44af-850b-074c4785dd44 None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:45.867117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1395/2744] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:26:45.873038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30de95-b23b-48e8-bce4-c919abdc9004 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:45.873758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30de95-b23b-48e8-bce4-c919abdc9004 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:45.874114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30de95-b23b-48e8-bce4-c919abdc9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:45.893478 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-8e30de95-b23b-48e8-bce4-c919abdc9004 None None] MFA Rules not processed for user `8aa0ee1eea094fcd8bdc87fcc630fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:45.897049 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8e30de95-b23b-48e8-bce4-c919abdc9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:45.904941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1350/2745] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:45.917866 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aceec-52cd-44af-850b-074c4785dd44 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:45.929766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aceec-52cd-44af-850b-074c4785dd44 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:45.933340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:45.933991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:45.934275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:45.934557 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:45.942198 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:45.943629 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46d319-f492-4de8-87de-da3786c728e3 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:45.952406 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1396/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:46.044184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8cb1-4cf0-4050-b04e-3f427fe56ef2 None None] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:46.044184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8cb1-4cf0-4050-b04e-3f427fe56ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:46.044184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8cb1-4cf0-4050-b04e-3f427fe56ef2 None None] PATH_INFO: `/` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:46.044184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1351/2747] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:26:46.046681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe36b-1fe2-40bc-b409-b1e4c0800833 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:46.047352 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe36b-1fe2-40bc-b409-b1e4c0800833 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:46.047697 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe36b-1fe2-40bc-b409-b1e4c0800833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:46.069944 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-973fe36b-1fe2-40bc-b409-b1e4c0800833 None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:46.071422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-973fe36b-1fe2-40bc-b409-b1e4c0800833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:46.091653 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1397/2748] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:46.096120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8cb1-4cf0-4050-b04e-3f427fe56ef2 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:46.113809 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8cb1-4cf0-4050-b04e-3f427fe56ef2 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:46.119064 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:46.119691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:46.120076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:46.120485 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:46.133349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:46.138208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:46.147162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1352/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:46.978053 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:46.978648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:46.978817 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:46.999905 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:47.001287 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:47.009828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1398/2750] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:47.024980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:47.037203 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325682-9548-41e6-8acd-48086385dcb4 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:47.044299 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:47.045011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:47.045490 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:47.045792 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:47.054717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:47.056362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:47.065269 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1353/2751] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:26:54.714383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:54.797204 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768ca5-1669-4fbe-aece-998acdcf4cda None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:54.804415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:54.804415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:54.804415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:54.804415 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] PATH_INFO: `/v3/users/b9240f01fbd54243a6a5c1714e176884` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:54.805524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9240f01fbd54243a6a5c1714e176884)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:54.807535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:55.084878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9240f01fbd54243a6a5c1714e176884'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.090456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:55.102443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9240f01fbd54243a6a5c1714e176884'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.110345 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9240f01fbd54243a6a5c1714e176884'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.111787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9240f01fbd54243a6a5c1714e176884'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.112496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9240f01fbd54243a6a5c1714e176884'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.210501 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1399/2752] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:26:54 2022] DELETE /identity/v3/users/b9240f01fbd54243a6a5c1714e176884 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:55.480753 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:55.495666 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041246c-0d30-4dd5-a18d-7725d8ede019 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:55.557987 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:55.558855 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:55.559130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:55.559502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] PATH_INFO: `/v3/projects/6380e58209c241de915583d03f2615ad` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:55.560801 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6380e58209c241de915583d03f2615ad)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:55.562714 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:55.702764 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6380e58209c241de915583d03f2615ad', 'request_id': 'req-d435db20-4b40-4f89-acdf-5ab102364c06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.706262 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:55.837114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6380e58209c241de915583d03f2615ad', 'request_id': 'req-d435db20-4b40-4f89-acdf-5ab102364c06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.844098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6380e58209c241de915583d03f2615ad', 'request_id': 'req-d435db20-4b40-4f89-acdf-5ab102364c06'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.854933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] The token cache is being invalidate because project 6380e58209c241de915583d03f2615ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:55.855220 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.855870 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:55.857439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1354/2753] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:26:55 2022] DELETE /identity/v3/projects/6380e58209c241de915583d03f2615ad => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:55.861470 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:55.862896 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:55.876093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170497e8-610e-4372-8eb1-7ecded5487b9 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:55.938338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:55.939361 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:55.939737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:55.940037 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] PATH_INFO: `/v3/users/d8725ce13f3e45018656a4c9d16b29bf` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:55.941467 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8725ce13f3e45018656a4c9d16b29bf)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:55.943588 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:56.444708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8725ce13f3e45018656a4c9d16b29bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:56.457508 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8725ce13f3e45018656a4c9d16b29bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:56.464442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8725ce13f3e45018656a4c9d16b29bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:56.465114 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8725ce13f3e45018656a4c9d16b29bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:56.465714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-66376e4a-efe3-4365-a506-bc29a642e916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8725ce13f3e45018656a4c9d16b29bf'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:56.587419 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1400/2754] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:26:55 2022] DELETE /identity/v3/users/d8725ce13f3e45018656a4c9d16b29bf => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:26:56.971330 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:56.972965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:56.988499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435db20-4b40-4f89-acdf-5ab102364c06 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:57.050277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:57.051170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.051456 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.051733 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] PATH_INFO: `/v3/projects/a575c23986eb4df7ae5436a92f20d34a` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.053011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a575c23986eb4df7ae5436a92f20d34a)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:57.055126 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:57.245308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a575c23986eb4df7ae5436a92f20d34a', 'request_id': 'req-08ad6690-9196-40b0-b452-94b55f4fd39f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.339435 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a575c23986eb4df7ae5436a92f20d34a', 'request_id': 'req-08ad6690-9196-40b0-b452-94b55f4fd39f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.346681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a575c23986eb4df7ae5436a92f20d34a', 'request_id': 'req-08ad6690-9196-40b0-b452-94b55f4fd39f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.358397 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] The token cache is being invalidate because project a575c23986eb4df7ae5436a92f20d34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:57.358683 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.359332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.360918 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1355/2755] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:26:56 2022] DELETE /identity/v3/projects/a575c23986eb4df7ae5436a92f20d34a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:03.536146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:03.536678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:03.536800 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:03.553771 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:03.554964 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:03.599130 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:03.610679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1401/2756] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:03.624695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:03.626105 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:03.702674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6690-9196-40b0-b452-94b55f4fd39f admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:03.708871 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:03.709515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:03.709816 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:03.710096 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:03.718161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:03.719755 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c73ad-6df9-449a-a349-f66d2a1faa6e service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:03.724158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:03.727867 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1356/2757] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:27:13.768637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:14.231802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:14.233213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:14.301706 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353588-a5da-4aac-84d7-770296c28456 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:14.307418 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:14.308052 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:14.308363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:14.308636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:14.310422 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:14.322067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:14.323648 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:14.334645 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1402/2758] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:27:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:24.329374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=32 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:48.176774 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:48.177308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:48.177308 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:48.196935 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] MFA Rules not processed for user `d46b4e1ae0bf4744a1b625fbe2ddbbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:48.210030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:48.253415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1357/2759] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:58.246463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=25 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:01.895683 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.897375 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:01.972253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7442-2899-4904-aab0-eb235323b3d5 service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.977723 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.983535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.983535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.983535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.983535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:01.994374 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.995961 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:02.007367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1403/2760] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:28:12.002832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=34 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:33.636221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:33.640337 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:33.702879 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e392a-bcb4-4173-8821-f4d202bdce8f None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:33.707546 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:33.708444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:33.708724 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:33.708999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] PATH_INFO: `/v3/users/a6f521b8eb1f421d999277094956b60f` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:33.710211 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f521b8eb1f421d999277094956b60f)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:33.712117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:33.942980 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f521b8eb1f421d999277094956b60f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:33.956302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f521b8eb1f421d999277094956b60f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:33.956994 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f521b8eb1f421d999277094956b60f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:33.957598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f521b8eb1f421d999277094956b60f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:33.964364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f521b8eb1f421d999277094956b60f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.085532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1358/2761] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:28:33 2022] DELETE /identity/v3/users/a6f521b8eb1f421d999277094956b60f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:34.363239 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:34.374537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4a99-c989-4676-b402-19ea3cf312f0 service nova] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:34.433413 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:34.434268 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:34.434540 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:34.434824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] PATH_INFO: `/v3/projects/ebccb04b931a426eb1023fb947a980e2` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:34.435972 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebccb04b931a426eb1023fb947a980e2)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:34.437894 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:34.630612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebccb04b931a426eb1023fb947a980e2', 'request_id': 'req-c46dce8a-e61f-4f8a-9425-232b897cce0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.733240 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebccb04b931a426eb1023fb947a980e2', 'request_id': 'req-c46dce8a-e61f-4f8a-9425-232b897cce0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.740023 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebccb04b931a426eb1023fb947a980e2', 'request_id': 'req-c46dce8a-e61f-4f8a-9425-232b897cce0f'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.752156 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] The token cache is being invalidate because project ebccb04b931a426eb1023fb947a980e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:28:34.752498 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.753146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:34.754727 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1404/2762] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:28:34 2022] DELETE /identity/v3/projects/ebccb04b931a426eb1023fb947a980e2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:34.758684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:34.760128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:34.779480 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7985b3e-8329-4a38-b29c-c9780697b171 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:34.832992 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:34.833878 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:34.834161 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:34.834438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] PATH_INFO: `/v3/users/6f927b56b9484b69a53d90dc1ab37486` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:34.835653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f927b56b9484b69a53d90dc1ab37486)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:34.837608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:34.859814 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:35.345441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f927b56b9484b69a53d90dc1ab37486'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:35.358087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f927b56b9484b69a53d90dc1ab37486'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:35.358716 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f927b56b9484b69a53d90dc1ab37486'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:35.359325 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f927b56b9484b69a53d90dc1ab37486'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:35.366030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-4e4f6b91-8a3f-4bdf-b80e-769fe72ccea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f927b56b9484b69a53d90dc1ab37486'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:35.686103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1359/2763] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:28:34 2022] DELETE /identity/v3/users/6f927b56b9484b69a53d90dc1ab37486 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:35.985977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:35.987943 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:36.002080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dce8a-e61f-4f8a-9425-232b897cce0f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:36.059882 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:36.060766 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:36.061059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:36.061353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] PATH_INFO: `/v3/projects/a1dccb0494444aec8b65b23ecffe958c` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:36.062571 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dccb0494444aec8b65b23ecffe958c)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:36.064539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:36.218661 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:36.230725 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dccb0494444aec8b65b23ecffe958c', 'request_id': 'req-8184e518-d01a-4de0-b994-01bb72a91729'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:36.384692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dccb0494444aec8b65b23ecffe958c', 'request_id': 'req-8184e518-d01a-4de0-b994-01bb72a91729'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:36.392522 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dccb0494444aec8b65b23ecffe958c', 'request_id': 'req-8184e518-d01a-4de0-b994-01bb72a91729'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:36.415040 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] The token cache is being invalidate because project a1dccb0494444aec8b65b23ecffe958c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:28:36.415463 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:36.416131 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:36.417775 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1405/2764] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:28:35 2022] DELETE /identity/v3/projects/a1dccb0494444aec8b65b23ecffe958c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:46.384757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:46.679457 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:55.785389 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:55.785882 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:55.786073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:55.805102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:55.806379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:55.863822 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1360/2765] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:56.216612 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:56.218050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:56.294974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e518-d01a-4de0-b994-01bb72a91729 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:56.300009 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:56.300694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:56.300963 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:56.301234 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:56.312324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:56.313966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f5da5-13a6-4200-9926-bc1156c0aab4 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:56.324235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1406/2766] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:28:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:29:05.857110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=25 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:06.325597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=32 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:13.791751 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:13.793228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:13.850287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817db4-b7ea-4e3c-a47c-6918b95cfe59 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:13.853981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:13.854608 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:13.854897 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:13.855174 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:13.857099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:13.925859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:13.927282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a839c-8d55-4b87-99ad-c656117a734a service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:13.938773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1361/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:16.092146 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:16.099188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:16.099188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] PATH_INFO: `/` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:16.099188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1407/2768] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 19 12:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:29:16.099528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:16.099528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:16.099528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:16.117557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] MFA Rules not processed for user `fe9f3e7fa6b24e17973f23be244ab083`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:29:16.118748 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:16.127979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1362/2769] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 19 12:29:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:29:16.139115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:16.140887 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:16.198957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72a8f-9c21-45aa-91e2-a9e1276913cc None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:16.202483 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f54fc2f2ba403c8fd8c871740d3403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:16.203117 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:16.203395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:16.203667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:16.214407 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:16.215847 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1eef4-9e9b-41b5-b03a-a44c1dd640fb service glance] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:16.226994 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1408/2770] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:17.113505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:17.115462 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:17.174382 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac28b3-52f3-4542-aafb-14949f57e5ed None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:17.177941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:17.179194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:17.179472 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:17.179741 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:17.181544 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:17.194649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:17.196079 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:17.209604 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1363/2771] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:29:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:19.139299 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:19.139756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:19.139852 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:19.156832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:29:19.158014 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:19.165102 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1409/2772] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:29:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:29:19.177103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:19.189229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c1333-ac26-48f3-b508-16a9defa0534 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:19.195242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:19.195540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:19.195825 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:19.196098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:19.204508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:19.206399 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941482a4-7e83-4c0a-beeb-269e782e7439 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:19.214543 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1364/2773] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:29:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:29:29.151928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=29 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:29.211224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:32.479334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:32.480851 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:32.492561 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372a637-ceca-429c-a450-6557b0bb2ff1 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:32.496047 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:32.496707 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:32.496983 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:32.497256 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:32.498927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:32.508803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:32.510213 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:32.518466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1410/2774] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:33.619391 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:33.619877 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:33.619971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:33.638075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:29:33.639276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:29:33.646275 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1365/2775] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:29:33.659080 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:33.671098 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf3ef-614a-4b23-b16b-7ad44ddb29a4 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:33.676034 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:33.676693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:33.676978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:33.677279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:33.685732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:33.687394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:33.696188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1411/2776] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:29:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:29:43.632865 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:43.692321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=12 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:08.533468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:08.535055 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:08.551354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90681b8-b93c-43c2-9701-6b786d9b327c None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:08.556767 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:08.557414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:08.557694 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:08.557970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:08.559737 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:08.573468 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:08.578442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:08.587988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1366/2777] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:12.203400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:12.205389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:12.219466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1897e8-0b76-4050-98bc-2d2ef3e07571 service swift] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:12.223236 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:12.228343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:12.228343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:12.228343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:12.228343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:12.290798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:12.292400 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:12.302197 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1412/2778] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:13.452912 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:13.462977 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579152-969e-4439-875b-152b1dcde6ab service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:13.466632 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:13.472142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:13.472142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:13.472142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:13.472142 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:13.532643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:13.534094 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:13.543364 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1367/2779] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:17.162093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:17.164340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:17.181183 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5510b-7eae-4f19-95d2-29d9bf965c42 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:17.186515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:17.187465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:17.187738 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:17.188006 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] PATH_INFO: `/v3/users/d46b4e1ae0bf4744a1b625fbe2ddbbc0` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:17.189264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46b4e1ae0bf4744a1b625fbe2ddbbc0)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:17.191755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:17.387464 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46b4e1ae0bf4744a1b625fbe2ddbbc0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:17.400957 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46b4e1ae0bf4744a1b625fbe2ddbbc0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:17.408619 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46b4e1ae0bf4744a1b625fbe2ddbbc0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:17.410733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46b4e1ae0bf4744a1b625fbe2ddbbc0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:17.410733 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-7451b878-fb60-47f0-aa05-811919e4f997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46b4e1ae0bf4744a1b625fbe2ddbbc0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:17.503384 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1413/2780] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:30:17 2022] DELETE /identity/v3/users/d46b4e1ae0bf4744a1b625fbe2ddbbc0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:30:17.773726 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:17.789965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569975f-3eb5-4edd-ac1d-48991ebcca25 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:17.855811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:17.856684 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:17.856995 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:17.857263 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] PATH_INFO: `/v3/projects/89b478cc21194d6680fcd4d6eb5ba4aa` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:17.858626 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b478cc21194d6680fcd4d6eb5ba4aa)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:17.860557 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:17.977896 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b478cc21194d6680fcd4d6eb5ba4aa', 'request_id': 'req-538ee81d-b544-4f0f-8462-27972c53a62a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:18.062076 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b478cc21194d6680fcd4d6eb5ba4aa', 'request_id': 'req-538ee81d-b544-4f0f-8462-27972c53a62a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:18.068922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b478cc21194d6680fcd4d6eb5ba4aa', 'request_id': 'req-538ee81d-b544-4f0f-8462-27972c53a62a'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:18.080099 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] The token cache is being invalidate because project 89b478cc21194d6680fcd4d6eb5ba4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:30:18.080362 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:18.081242 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-538ee81d-b544-4f0f-8462-27972c53a62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:30:18.082808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1368/2781] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:30:17 2022] DELETE /identity/v3/projects/89b478cc21194d6680fcd4d6eb5ba4aa => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:30:18.087708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.088126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.088423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.106687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:30:18.108410 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:18.165700 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1414/2782] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:30:18.174276 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.174561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.174836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.193564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:30:18.194761 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:18.202723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1369/2783] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:30:18.206958 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.216532 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08fb6-4d7e-42ff-bc4f-0387083f88e6 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.220976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.221642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.221919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.222187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.222897 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:30:18.223195 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.224799 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.231367 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:18.236842 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1415/2784] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:30:18.240998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.246618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:18.251087 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7943e-752d-4a12-bc22-bc012ef4a075 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.255641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.256309 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.256593 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.256864 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.257537 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.259411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.531120 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1370/2785] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:30:18 2022] POST /identity/v3/projects => generated 375 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:30:18.535336 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.545761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624b932-4732-44d7-a921-d9b48001b964 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.602599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.603185 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.603777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.604050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.604753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.606637 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.771527 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1416/2786] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:30:18 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:30:18.775682 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.786601 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804b8d-f02f-4e74-a01e-1452a3dcbdf8 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.791050 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.791697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.791975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.792277 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.793066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.795186 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.804843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1371/2787] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:30:18.808768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.819493 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6243b-8948-4e81-9d94-4fbe57cdef3a admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.824073 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.824790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.825077 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.825355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.826072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.827681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa321d3-e11d-4c91-af4c-91924dfb0815 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.837924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1417/2788] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:30:18.842029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:18.851835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3211-dd03-4134-987a-7124f57afe06 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:18.856410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:18.857735 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.858012 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.858282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] PATH_INFO: `/v3/projects/85b5315c2af64054a87151a70668d4b9/users/b7972aeeaa2148ca9a56c265a669882a/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.874202 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b5315c2af64054a87151a70668d4b9, user_id=b7972aeeaa2148ca9a56c265a669882a, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:18.876922 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:18.946225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1372/2789] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:30:18 2022] PUT /identity/v3/projects/85b5315c2af64054a87151a70668d4b9/users/b7972aeeaa2148ca9a56c265a669882a/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:30:18.954396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cfbe-100a-40af-b09f-e08deaa864c5 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:18.954693 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cfbe-100a-40af-b09f-e08deaa864c5 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:18.955004 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cfbe-100a-40af-b09f-e08deaa864c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:18.973510 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-44b8cfbe-100a-40af-b09f-e08deaa864c5 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:30:18.989816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-44b8cfbe-100a-40af-b09f-e08deaa864c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:19.034770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1418/2790] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:30:19.044398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:19.046062 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:19.104061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11bc32-272f-46aa-961f-23f52ef080dd admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:19.107796 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:19.108420 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:19.108697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:19.108975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:19.117911 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:19.119344 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:19.129821 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1373/2791] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:24.860815 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d707-1512-418e-8ba8-11d8c48b4c4f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:24.861343 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d707-1512-418e-8ba8-11d8c48b4c4f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:24.861517 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d707-1512-418e-8ba8-11d8c48b4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:24.891507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-2eb4d707-1512-418e-8ba8-11d8c48b4c4f None None] MFA Rules not processed for user `b7972aeeaa2148ca9a56c265a669882a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:30:24.892789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2eb4d707-1512-418e-8ba8-11d8c48b4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:24.967453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1419/2792] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:30:24.984915 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:24.986669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:25.070553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783634a-7679-4193-ae97-967ac6ee0e3b service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:25.076762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:25.077404 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:25.077681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:25.077950 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:25.086192 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:25.088036 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:25.096760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1374/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:27.584472 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:27.584978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:27.585160 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:27.598311 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:27.604466 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] MFA Rules not processed for user `b7972aeeaa2148ca9a56c265a669882a`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:30:27.605715 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:27.613423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1420/2794] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:30:27.958463 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:27.960170 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:27.973228 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1a362-74c2-471d-b667-0d0afbefdf5f service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:27.977256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:27.977941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:27.978224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:27.978499 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:27.980335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:27.990686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:27.992385 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:28.002068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1375/2795] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:30.537165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:30.538609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:30.643066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c116-edf8-4ac4-9c51-3487d7b26ca3 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:30.648244 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:30.649340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:30.650688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:30.650951 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:30.652757 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:30.665129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:30.666742 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:30.677123 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1421/2796] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:37.997581 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.672917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=47 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:42.694487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:42.696690 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:42.746572 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312116d-cb6c-409a-8f93-d79f715f13ed service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:42.753056 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:42.753797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:42.754387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:42.754734 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:42.756691 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:42.769868 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:42.772627 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977dc2-9e31-44ea-a0cc-4515849a4f4f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:42.782799 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1376/2797] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:52.778282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=19 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:21.519319 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:21.520751 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:21.572356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5699-ea7e-48c5-a592-30d46caa6f9e service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:21.578029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:21.578660 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:21.578936 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:21.579202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:21.580977 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:21.592330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:21.593823 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:21.604048 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1422/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:31.599746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=22 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:12.969528 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:12.970075 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:12.970185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:12.987439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] MFA Rules not processed for user `b7972aeeaa2148ca9a56c265a669882a`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:33:12.989188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:12.995906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1377/2799] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:33:13.298401 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:33:13.317592 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6a6-8d48-403c-9cbf-42c8f5109220 service placement] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:33:13.321349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:33:13.321993 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:13.322272 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:13.322544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:13.324334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:13.348484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:33:13.350094 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:33:13.358604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1423/2800] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:33:22.982628 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:23.354731 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=15 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:26.547554 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:33:26.579780 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393a82c-d5bd-4237-b003-a4a951f1e2cb None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:33:26.593853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:33:26.594668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:26.595016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:26.595282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:26.598204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:26.625073 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:33:26.626693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:33:26.637831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1378/2801] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:33:36.633981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=18 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:14.140912 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:14.142321 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:14.222662 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe46bb-113e-42d9-add7-77fd7f10a14f service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:14.226446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:14.227116 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:14.227396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:14.227667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:14.229490 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:14.243594 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:14.244984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:14.256340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1424/2802] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:17.540717 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:17.550403 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7ccb-51d7-4168-b032-0c7216663d4f service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:17.553937 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:17.554569 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:17.554856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:17.555130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:17.556934 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:17.570686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:17.572111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:17.583018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1379/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:24.251187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=35 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:27.578156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=6 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:29.643776 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:29.676774 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccfc9a-8676-430a-b6a4-574a716e996f service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:29.681762 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:29.682641 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:29.682918 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:29.683193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] PATH_INFO: `/v3/users/b7972aeeaa2148ca9a56c265a669882a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:29.684459 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7972aeeaa2148ca9a56c265a669882a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:29.686485 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:29.892026 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7972aeeaa2148ca9a56c265a669882a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:29.905768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7972aeeaa2148ca9a56c265a669882a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:29.913279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7972aeeaa2148ca9a56c265a669882a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:29.914021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7972aeeaa2148ca9a56c265a669882a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:29.914618 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-16842ed5-8ea6-4d17-9aa7-ba53422f361a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7972aeeaa2148ca9a56c265a669882a'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.024288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1425/2804] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:34:29 2022] DELETE /identity/v3/users/b7972aeeaa2148ca9a56c265a669882a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:30.288450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:30.299831 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361b2d2-24a0-45ab-b571-1d08d818dacd service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:30.363578 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:30.364473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:30.364765 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:30.365037 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] PATH_INFO: `/v3/projects/85b5315c2af64054a87151a70668d4b9` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:30.366227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b5315c2af64054a87151a70668d4b9)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:30.368171 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:30.487696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b5315c2af64054a87151a70668d4b9', 'request_id': 'req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.566486 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b5315c2af64054a87151a70668d4b9', 'request_id': 'req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.573379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b5315c2af64054a87151a70668d4b9', 'request_id': 'req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.598853 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] The token cache is being invalidate because project 85b5315c2af64054a87151a70668d4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:34:30.599132 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.599785 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-8be3e89d-91f0-4ae6-8676-5ef9c2338dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:30.601338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1380/2805] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:34:30 2022] DELETE /identity/v3/projects/85b5315c2af64054a87151a70668d4b9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:30.606759 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:30.607089 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:30.607365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:30.664222 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:30.672881 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:30.728255 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1426/2806] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:30.737182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:30.737469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:30.737805 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:30.756217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:30.757442 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:30.765508 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1381/2807] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:30.769761 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:30.779607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3ae47-f3ef-49fe-8ca2-fbc00e060e1a None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:30.784514 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:30.785188 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:30.785465 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:30.785735 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:30.786441 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:34:30.786741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:30.788369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:30.800364 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1427/2808] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:34:30.804643 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:30.814548 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1ea47-a95d-40be-94b1-c52c487bcd3e None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:30.819172 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:30.819930 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:30.820235 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:30.820563 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:30.821256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:30.823237 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:30.957598 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1382/2809] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:34:30 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:34:30.962310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:30.972620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778e7a-c428-4bca-8ffb-98d1e1f6d1b8 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:30.982347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:31.029365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.029941 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.030217 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.030487 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.031157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.033155 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.115781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1428/2810] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:34:30 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:31.120018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.130649 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f8a1-f410-4430-846a-c448acf3bb4c admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.135615 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.136303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.136610 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.136881 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.137586 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.139217 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.150017 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1383/2811] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:31.154730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.165113 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e1e9-a407-4e4e-9eaf-3b16fc70aa39 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.170389 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.171045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.171323 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.171591 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.172347 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.173932 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f830-f120-47a0-a5c3-c8c48d498396 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.184614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1429/2812] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:34:31.189434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.200246 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260402f-7386-4143-ae9f-464b67ffa921 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.205026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.206016 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.206394 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.206760 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] PATH_INFO: `/v3/projects/735e79a213224d9ca731a0edd35c6ba7/users/1108f78c584a443fa445f56b440ce09e/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.226501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735e79a213224d9ca731a0edd35c6ba7, user_id=1108f78c584a443fa445f56b440ce09e, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.229274 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.299811 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1384/2813] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:31 2022] PUT /identity/v3/projects/735e79a213224d9ca731a0edd35c6ba7/users/1108f78c584a443fa445f56b440ce09e/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:31.310068 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.310358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.310631 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.340423 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] MFA Rules not processed for user `1108f78c584a443fa445f56b440ce09e`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:31.341649 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:31.409636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1430/2814] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:31.414117 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.432264 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:31.484418 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fce2c-2558-4e6c-a2d8-15cc8688f460 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.489109 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.489759 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.490038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.490312 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.490993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.492984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.649519 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1385/2815] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:34:31 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:31.654484 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.666982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e9c2-a69d-4012-9e7a-27a483f0954f None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.730549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.731212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.731496 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.731769 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.732492 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.734383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.904455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1431/2816] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:34:31 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:31.908426 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.918863 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa6a8-e496-48ae-bf43-1287f6a714da admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.923556 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.924250 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.925782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.925782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.925782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.927158 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:31.938859 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1386/2817] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:31.943251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:31.954340 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13b1f-c38e-4770-b741-ce5a78b96d24 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:31.959163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:31.960050 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:31.960370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:31.960650 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] PATH_INFO: `/v3/projects/8ae0950d321947238f83451a563c7c47/users/3a3704a1c8b047c58252f0fbf470a1b4/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:31.970655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:31.977549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae0950d321947238f83451a563c7c47, user_id=3a3704a1c8b047c58252f0fbf470a1b4, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:31.980370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:32.121803 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1432/2818] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:31 2022] PUT /identity/v3/projects/8ae0950d321947238f83451a563c7c47/users/3a3704a1c8b047c58252f0fbf470a1b4/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:32.125856 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:32.136411 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097fafc-70fb-4696-82a4-3416042af457 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:32.198597 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:32.199207 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:32.199489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:32.199763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:32.200505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:32.202114 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002836-8dc1-4a8b-bc03-855b3344a171 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:32.212444 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1387/2819] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:32.216636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:32.227032 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc432e8-0568-488c-a1ed-bd984050c303 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:32.232344 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:32.233218 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:32.233518 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:32.233781 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] PATH_INFO: `/v3/projects/8ae0950d321947238f83451a563c7c47/users/3a3704a1c8b047c58252f0fbf470a1b4/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:32.235713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae0950d321947238f83451a563c7c47, user_id=3a3704a1c8b047c58252f0fbf470a1b4, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:32.238363 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:32.249576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1433/2820] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:32 2022] PUT /identity/v3/projects/8ae0950d321947238f83451a563c7c47/users/3a3704a1c8b047c58252f0fbf470a1b4/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:32.261317 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:32.261687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:32.261861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:32.288795 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] MFA Rules not processed for user `3a3704a1c8b047c58252f0fbf470a1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:32.290006 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:32.365981 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1388/2821] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:32.377558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:32.379411 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:32.441923 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ab9d-d33d-4b9c-be16-d360f990cd84 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:32.445873 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:32.446530 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:32.446814 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:32.447092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:32.457568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:32.459212 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:32.469833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1434/2822] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:32.665042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:32.675347 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c7852-02e1-4dfb-9b8c-752eef5136be None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:32.687296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:32.687953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:32.688261 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:32.688736 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:32.697985 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:32.747465 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:32.749184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893952c-8b54-4df3-839d-90ae6816c4c2 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:32.758241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1389/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:36.381903 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:36.452549 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b9c-243a-4b9e-87c2-796e8743d6e7 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:36.457454 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:36.458335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:36.458604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:36.459129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] PATH_INFO: `/v3/users/1108f78c584a443fa445f56b440ce09e` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:36.460395 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1108f78c584a443fa445f56b440ce09e)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:36.462298 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:36.645163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1108f78c584a443fa445f56b440ce09e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:36.657305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1108f78c584a443fa445f56b440ce09e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:36.664307 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1108f78c584a443fa445f56b440ce09e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:36.665018 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1108f78c584a443fa445f56b440ce09e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:36.665624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1108f78c584a443fa445f56b440ce09e'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:36.669874 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:36.743928 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1435/2824] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:34:36 2022] DELETE /identity/v3/users/1108f78c584a443fa445f56b440ce09e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:36.749286 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:36.754640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:36.754640 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:36.767074 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:36.768328 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:36.841297 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1390/2825] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:34:36.851226 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:36.854624 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:36.912728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4340a1-f20a-46f6-8292-127bc2ba98eb admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:36.916327 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:36.916970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:36.917247 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:36.917515 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:36.927341 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:36.928802 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:36.939039 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1436/2826] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:37.425434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:37.427131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:37.439541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642aee0-1aca-47e7-9b51-fbeb3a8d07e7 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:37.444175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:37.445065 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:37.445349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:37.445623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] PATH_INFO: `/v3/projects/735e79a213224d9ca731a0edd35c6ba7` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:37.447434 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735e79a213224d9ca731a0edd35c6ba7)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:37.455758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:37.613194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735e79a213224d9ca731a0edd35c6ba7', 'request_id': 'req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.698634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735e79a213224d9ca731a0edd35c6ba7', 'request_id': 'req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.706612 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735e79a213224d9ca731a0edd35c6ba7', 'request_id': 'req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.718346 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] The token cache is being invalidate because project 735e79a213224d9ca731a0edd35c6ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:34:37.718634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.719301 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.721007 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1391/2827] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:34:37 2022] DELETE /identity/v3/projects/735e79a213224d9ca731a0edd35c6ba7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:37.724819 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:37.734577 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f07e7-4bf7-4a10-9499-6b813e6a2859 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:37.792191 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:37.793161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:37.793444 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:37.793728 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] PATH_INFO: `/v3/users/3a3704a1c8b047c58252f0fbf470a1b4` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:37.794937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3704a1c8b047c58252f0fbf470a1b4)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:37.796889 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:37.963196 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3704a1c8b047c58252f0fbf470a1b4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.977899 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3704a1c8b047c58252f0fbf470a1b4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.985128 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3704a1c8b047c58252f0fbf470a1b4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.985909 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3704a1c8b047c58252f0fbf470a1b4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:37.986524 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-ff990efd-0b24-4c4a-b4b8-fe45e1808b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3704a1c8b047c58252f0fbf470a1b4'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.077142 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1437/2828] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:34:37 2022] DELETE /identity/v3/users/3a3704a1c8b047c58252f0fbf470a1b4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:38.509219 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:38.511147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:38.525388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eb60-caf4-4c80-bf6d-3fb32fdfacb5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:38.558042 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:38.585204 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:38.586098 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:38.586377 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:38.586650 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] PATH_INFO: `/v3/projects/8ae0950d321947238f83451a563c7c47` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:38.587885 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae0950d321947238f83451a563c7c47)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:38.590160 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:38.749703 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae0950d321947238f83451a563c7c47', 'request_id': 'req-569497d4-a61d-4c3b-994c-2915f034c4af'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.880961 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae0950d321947238f83451a563c7c47', 'request_id': 'req-569497d4-a61d-4c3b-994c-2915f034c4af'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.887664 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae0950d321947238f83451a563c7c47', 'request_id': 'req-569497d4-a61d-4c3b-994c-2915f034c4af'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.898482 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] The token cache is being invalidate because project 8ae0950d321947238f83451a563c7c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:34:38.898762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.899388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-569497d4-a61d-4c3b-994c-2915f034c4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:38.900942 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1392/2829] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:34:38 2022] DELETE /identity/v3/projects/8ae0950d321947238f83451a563c7c47 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:38.906669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:38.907790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:38.907790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:38.925342 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:38.926666 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:38.938950 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:38.987232 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1438/2830] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:38.995052 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:38.999941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:38.999941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.014201 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:39.015489 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:39.023790 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1393/2831] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:39.028058 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.038576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3615-8800-43c4-b68f-b5af25e51c63 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.043445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.044104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.044453 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.044732 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.045507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:34:39.045858 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.047754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.063521 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1439/2832] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:34:39.065320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.074772 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f101bf3-2880-4a16-97e2-04226379c022 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.080933 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.086078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.086078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.086078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.086078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.086078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.203602 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1394/2833] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:34:39 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:39.208927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.219580 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430ae9-7186-44c1-861b-f77a4d1bb347 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.282249 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.282834 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.283122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.283394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.284085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.286083 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.373161 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1440/2834] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:34:39 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:39.377481 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.391959 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f460c44-8fc4-41f4-9f71-15d6ae93f2f7 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.396731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.397398 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.397696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.397965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.398681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.400287 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.411162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1395/2835] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:39.415429 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.429370 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d5c7e-ffe9-4ef5-b92f-46caff91597c admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.434542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.435712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.435988 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.436288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.437007 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.438587 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678798ab-15e3-414e-9f2f-30dd488a962b admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.449044 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1441/2836] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:39.453923 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.464015 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396008-4e26-48a4-9dec-df8cebef80c9 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.468540 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.469405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.469687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.469955 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] PATH_INFO: `/v3/projects/4901817f00f645ca8645732bb6cdb107/users/399a10eb7ee540f09f258b36ccb29090/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.484387 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4901817f00f645ca8645732bb6cdb107, user_id=399a10eb7ee540f09f258b36ccb29090, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.486975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.562824 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1396/2837] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:39 2022] PUT /identity/v3/projects/4901817f00f645ca8645732bb6cdb107/users/399a10eb7ee540f09f258b36ccb29090/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:39.572711 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.572998 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.578072 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.602022 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] MFA Rules not processed for user `399a10eb7ee540f09f258b36ccb29090`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:39.603228 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:39.674789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1442/2838] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:39.679294 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.742137 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ac1d-39ba-4f0b-a8a9-5555a4821bc3 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.748302 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.748962 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.749244 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.749512 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.750200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.752240 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:39.755693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:39.865857 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1397/2839] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:34:39 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:34:39.870136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:39.881917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ffc6-57b7-4c34-97f1-e847bd2543f8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:39.897314 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:39.948029 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:39.948916 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:39.949438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:39.950106 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:39.950967 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:39.952976 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.111201 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1443/2840] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:34:39 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:34:40.116111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:40.126535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a3e0-ad89-473e-9a8e-66681765e986 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:40.131135 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:40.131787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.132102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.132369 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.133080 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:40.134672 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.145470 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1398/2841] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:40.152163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:40.162828 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd4d7-f1bb-4565-afea-2a5f92c38f9f admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:40.167529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:40.168424 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.168704 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.168973 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] PATH_INFO: `/v3/projects/caff0d2f831747c1b7e73f64a11887db/users/5299673806fc4d4ba22e5367376bf1ce/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.194145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caff0d2f831747c1b7e73f64a11887db, user_id=5299673806fc4d4ba22e5367376bf1ce, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:40.196789 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.293495 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1444/2842] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:40 2022] PUT /identity/v3/projects/caff0d2f831747c1b7e73f64a11887db/users/5299673806fc4d4ba22e5367376bf1ce/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:40.298450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:40.308743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90240e-ee25-4ab4-b794-f0435b856d9a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:40.369111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:40.373439 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.373732 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.374009 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.374745 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:40.376410 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7812405-be67-45df-8f0e-31fd09f981e7 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.386953 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1399/2843] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:34:40.391788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:40.402708 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bd89-a1fe-491c-9612-3c19afc9ef91 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:40.408177 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:40.409085 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.409365 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.409636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] PATH_INFO: `/v3/projects/caff0d2f831747c1b7e73f64a11887db/users/5299673806fc4d4ba22e5367376bf1ce/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.411628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caff0d2f831747c1b7e73f64a11887db, user_id=5299673806fc4d4ba22e5367376bf1ce, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:40.414279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.425012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1445/2844] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:34:40 2022] PUT /identity/v3/projects/caff0d2f831747c1b7e73f64a11887db/users/5299673806fc4d4ba22e5367376bf1ce/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:40.436979 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.437272 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.437553 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.464763 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] MFA Rules not processed for user `5299673806fc4d4ba22e5367376bf1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:40.468320 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:40.545241 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1400/2845] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:40.556010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:40.557833 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:40.624674 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f94a4-8ef5-411d-b71d-505180a80360 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:40.628455 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:40.629115 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:40.629397 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:40.629679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:40.687271 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:40.688754 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:40.697743 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1446/2846] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:44.051198 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:44.060941 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42708346-ac2a-4a93-9bff-b41e7f8b4257 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:44.064990 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:44.065118 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:44.065340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:44.065614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:44.074721 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:44.076154 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74380a-d708-4861-b923-a45957be5ad0 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:44.086234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1401/2847] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:50.693679 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:54.081634 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:58.857012 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:58.921737 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b97324-e78e-4382-a8ed-e65901db2c79 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:58.926203 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:58.927057 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:58.927338 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:58.927609 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] PATH_INFO: `/v3/users/399a10eb7ee540f09f258b36ccb29090` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:58.928797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] RBAC: Authorizing `identity:delete_user(user_id=399a10eb7ee540f09f258b36ccb29090)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:58.930722 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:59.105911 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399a10eb7ee540f09f258b36ccb29090'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:59.117917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399a10eb7ee540f09f258b36ccb29090'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:59.125369 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399a10eb7ee540f09f258b36ccb29090'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:59.126035 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399a10eb7ee540f09f258b36ccb29090'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:59.126635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399a10eb7ee540f09f258b36ccb29090'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:34:59.206126 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1447/2848] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:34:58 2022] DELETE /identity/v3/users/399a10eb7ee540f09f258b36ccb29090 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:34:59.211284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:59.212020 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:59.212185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:59.229740 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:34:59.239373 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:59.287808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1402/2849] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:34:59.298548 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:59.300120 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:59.358045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89f8d-9038-4a49-8f71-7b8c0995635e admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:59.361567 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:59.362202 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:59.362477 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:59.362746 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:59.371353 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:59.373435 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:59.382623 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1448/2850] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:59.819224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:59.820665 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:59.834429 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc68853-df7f-47e6-badc-8f731922fd6b None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:59.839245 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:59.840019 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:59.840334 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:59.840614 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] PATH_INFO: `/v3/projects/4901817f00f645ca8645732bb6cdb107` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:59.841800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4901817f00f645ca8645732bb6cdb107)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:59.843743 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:59.955349 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4901817f00f645ca8645732bb6cdb107', 'request_id': 'req-f4f0263f-745c-4255-bdbd-4af6e9ac6372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.023031 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4901817f00f645ca8645732bb6cdb107', 'request_id': 'req-f4f0263f-745c-4255-bdbd-4af6e9ac6372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.030131 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4901817f00f645ca8645732bb6cdb107', 'request_id': 'req-f4f0263f-745c-4255-bdbd-4af6e9ac6372'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.040375 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] The token cache is being invalidate because project 4901817f00f645ca8645732bb6cdb107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:00.040659 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.041284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.042830 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1403/2851] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:34:59 2022] DELETE /identity/v3/projects/4901817f00f645ca8645732bb6cdb107 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:00.047033 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:00.056614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d717-2a3a-4500-9814-c5f74ec23fc5 service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:00.074096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:00.112863 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:00.113790 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:00.114066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:00.114335 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] PATH_INFO: `/v3/users/5299673806fc4d4ba22e5367376bf1ce` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:00.115491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5299673806fc4d4ba22e5367376bf1ce)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:00.117446 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:00.419787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5299673806fc4d4ba22e5367376bf1ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.431541 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5299673806fc4d4ba22e5367376bf1ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.438870 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5299673806fc4d4ba22e5367376bf1ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.439535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5299673806fc4d4ba22e5367376bf1ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.440137 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-a1bf045d-e992-4591-a8e4-2472c2993484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5299673806fc4d4ba22e5367376bf1ce'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:00.554346 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1449/2852] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:35:00 2022] DELETE /identity/v3/users/5299673806fc4d4ba22e5367376bf1ce => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:01.037068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.040875 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:01.052531 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0263f-745c-4255-bdbd-4af6e9ac6372 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.111797 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.112704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.112986 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.113255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] PATH_INFO: `/v3/projects/caff0d2f831747c1b7e73f64a11887db` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.114535 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] RBAC: Authorizing `identity:delete_project(project_id=caff0d2f831747c1b7e73f64a11887db)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.116458 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.225575 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:01.243224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caff0d2f831747c1b7e73f64a11887db', 'request_id': 'req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:01.309282 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caff0d2f831747c1b7e73f64a11887db', 'request_id': 'req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:01.316723 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caff0d2f831747c1b7e73f64a11887db', 'request_id': 'req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:01.328048 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] The token cache is being invalidate because project caff0d2f831747c1b7e73f64a11887db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:01.328396 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:01.329068 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-9134c7d3-6dee-45a9-96e4-63c4eaeb700f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:01.330758 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1404/2853] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:35:01 2022] DELETE /identity/v3/projects/caff0d2f831747c1b7e73f64a11887db => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:01.336753 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.337235 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.337334 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.354798 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:01.355982 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:01.414170 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1450/2854] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:01.422222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.422515 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.424501 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.441547 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:01.442762 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:01.450637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1405/2855] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:01.455067 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.464845 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b533693-5224-4546-be1f-97a24436a9f8 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.469355 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.469991 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.470275 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.470544 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.471251 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:35:01.471551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.473157 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.484914 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1451/2856] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:35:01.489111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.498506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad8f8b-554f-4a2e-a590-ac7b7679defa None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.504111 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.504784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.505061 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.505332 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.506018 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.507951 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.591380 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1406/2857] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:35:01 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:01.596145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.606215 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318e25e-c251-47e0-aed4-090004a750d4 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.631610 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:01.662825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.663486 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.663770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.664043 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.664755 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.666692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.772440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1452/2858] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:35:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:01.776810 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.787322 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f319-cf47-4ba0-9618-ee188d0d1c2d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.791999 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.792696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.792983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.793279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.794029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.795655 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.806229 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1407/2859] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:01.810150 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.820614 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a698-2845-4d83-818d-caad9f2b8949 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.825139 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.825797 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.826059 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.826330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.827688 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.829288 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7673e-bf08-4946-872f-fb33700e987c admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.839386 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1453/2860] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:01.843256 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:01.853234 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22dfd-e681-42dc-829e-2aa1c3b0bea0 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:01.857778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:01.858647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.858928 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.859200 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] PATH_INFO: `/v3/projects/b2dbeb905d3a4b7a9d5898e4d059c34a/users/cd6d37acf61748f8ab498691306611d4/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:01.873222 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2dbeb905d3a4b7a9d5898e4d059c34a, user_id=cd6d37acf61748f8ab498691306611d4, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:01.876448 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:01.978077 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1408/2861] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:35:01 2022] PUT /identity/v3/projects/b2dbeb905d3a4b7a9d5898e4d059c34a/users/cd6d37acf61748f8ab498691306611d4/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:01.988380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:01.988671 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:01.988948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.017291 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] MFA Rules not processed for user `cd6d37acf61748f8ab498691306611d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:02.018586 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:02.081736 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1454/2862] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:02.086441 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.146044 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd48ff8-5a38-4d1e-a07b-334d74b6b0a5 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.150653 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.151303 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.151583 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.151854 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.152566 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.154446 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.299678 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1409/2863] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:35:02 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:02.303669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.315065 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc7aaf-d51b-40f5-8073-74233286d871 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.372768 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.373428 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.373705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.373974 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.374745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.376675 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.509134 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1455/2864] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:35:02 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:02.513134 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.524326 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448da-348c-4f86-bf5f-1638b976714d admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.528965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.529619 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.529904 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.530178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.530891 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.532529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.542887 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1410/2865] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:02.546692 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.556730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310f1c-859a-4fc3-80eb-c7d7c19a6691 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.561745 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.562391 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.562667 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.562949 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.563659 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.565276 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72349857-a8c3-4f99-9e0e-12350b125840 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.574919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1456/2866] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:02.579363 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.589239 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400a70-81ca-45d5-a7ca-c4473bd57a19 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.593687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.594541 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.594827 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.595102 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] PATH_INFO: `/v3/projects/e10fd4ea4d63440ea4fdb9c5215669bb/users/1d362dcef6164e44930b8f88bf10cf50/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.609340 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10fd4ea4d63440ea4fdb9c5215669bb, user_id=1d362dcef6164e44930b8f88bf10cf50, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.611971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.688178 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:02.692836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1411/2867] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:35:02 2022] PUT /identity/v3/projects/e10fd4ea4d63440ea4fdb9c5215669bb/users/1d362dcef6164e44930b8f88bf10cf50/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:02.711801 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.712092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.712421 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.738456 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] MFA Rules not processed for user `1d362dcef6164e44930b8f88bf10cf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:02.741408 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:02.743643 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:02.802713 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1457/2868] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:02.807637 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.870162 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c19e-ea0a-458c-b9dd-50ecb47a4236 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:02.875521 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:02.876173 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:02.876487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:02.876791 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:02.877483 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:02.879438 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:02.978579 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1412/2869] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:35:02 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:02.983381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:02.994076 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081df82-2f8e-4911-86e3-bd467d1ce3d0 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.049782 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.050458 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.050748 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.051024 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] PATH_INFO: `/v3/users` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.051741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.053655 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.166585 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1458/2870] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:35:02 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:35:03.171218 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:03.181697 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f35eb-3a26-44a8-8ad4-30afd53e0170 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.186834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.187576 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.187866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.188147 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.188909 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.190507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.200983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1413/2871] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:03.205100 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:03.215129 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93948cb-0a44-484f-bb8d-0c4c03e3244d admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.220265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.221136 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.221442 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.221720 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] PATH_INFO: `/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d/users/ebd9e5c8702549fcbd7552d01b8b5645/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.236853 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61626a3b2ca94d5e92ce7f66f481b21d, user_id=ebd9e5c8702549fcbd7552d01b8b5645, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.239512 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.315440 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1459/2872] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:35:03 2022] PUT /identity/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d/users/ebd9e5c8702549fcbd7552d01b8b5645/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:03.319352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:03.329494 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf6f2-90bf-4d37-957a-816d6305a72a admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.390388 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.391051 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.391335 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.391609 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.392443 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.394184 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb3547-e8f0-4ab6-bce2-80a4857253e0 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.406284 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1414/2873] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:03.410394 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:03.421250 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e775ce-d790-4ad2-852c-f6bd4c278935 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.427898 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.428816 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.429101 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.429376 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] PATH_INFO: `/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d/users/ebd9e5c8702549fcbd7552d01b8b5645/roles/dca1ff9766074e53aabc5609addb3b37` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.431383 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61626a3b2ca94d5e92ce7f66f481b21d, user_id=ebd9e5c8702549fcbd7552d01b8b5645, role_id=dca1ff9766074e53aabc5609addb3b37)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.434021 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.444143 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1460/2874] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:35:03 2022] PUT /identity/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d/users/ebd9e5c8702549fcbd7552d01b8b5645/roles/dca1ff9766074e53aabc5609addb3b37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:03.476793 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.477185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.477507 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.505156 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] MFA Rules not processed for user `ebd9e5c8702549fcbd7552d01b8b5645`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:03.507477 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:03.567802 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:03.577038 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1415/2875] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:03.587990 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:03.589694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:03.645358 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d593-af65-4a40-9cdb-0f07b05385d2 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:03.648966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:03.649608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:03.649878 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:03.650151 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:03.659542 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:03.660979 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:03.665825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:03.670535 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1461/2876] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:04.836605 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:04.837993 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:04.850259 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a89b5-39a9-47bf-8ec8-1dcdd55b80a5 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:04.853834 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:04.854473 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:04.854757 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:04.855030 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:04.911459 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:04.912945 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:04.923208 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1416/2877] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:10.026109 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:10.035714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e7db-08c1-4889-89c5-85a22beadd14 service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:10.039506 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:10.040173 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:10.040608 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:10.045451 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:10.098329 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:10.099777 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc3c0-5b67-4143-9591-cc0e00e8d9da service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:10.108712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1462/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:14.618866 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:14.681078 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4cbc-0492-49b2-bf5e-2135d098b1e7 service cinder] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:14.685518 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:14.686361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:14.686639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:14.686906 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] PATH_INFO: `/v3/users/cd6d37acf61748f8ab498691306611d4` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:14.688097 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6d37acf61748f8ab498691306611d4)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:14.690029 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:14.899452 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6d37acf61748f8ab498691306611d4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:14.913361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6d37acf61748f8ab498691306611d4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:14.914166 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6d37acf61748f8ab498691306611d4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:14.914769 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6d37acf61748f8ab498691306611d4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:14.921529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6d37acf61748f8ab498691306611d4'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:14.999969 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1417/2879] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:35:14 2022] DELETE /identity/v3/users/cd6d37acf61748f8ab498691306611d4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:15.004443 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:15.004924 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:15.005045 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:15.022730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:15.023927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:15.081812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1463/2880] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:15.091704 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:15.093095 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:15.107039 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:15.149000 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de35a51-d9d9-44bc-b4b3-e4cc5334d22b admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:15.153651 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:15.154225 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:15.154502 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:15.154773 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:15.163731 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:15.165175 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:15.174361 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1418/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:15.579056 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:15.580927 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:15.595380 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdec19-a971-4396-a90e-43e8d3d849b7 None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:15.600563 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:15.601449 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:15.601729 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:15.601996 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] PATH_INFO: `/v3/projects/b2dbeb905d3a4b7a9d5898e4d059c34a` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:15.603169 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2dbeb905d3a4b7a9d5898e4d059c34a)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:15.605088 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:15.755127 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2dbeb905d3a4b7a9d5898e4d059c34a', 'request_id': 'req-2c91fa95-684e-4323-a5c4-d52be5e92391'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:15.839756 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2dbeb905d3a4b7a9d5898e4d059c34a', 'request_id': 'req-2c91fa95-684e-4323-a5c4-d52be5e92391'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:15.846286 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2dbeb905d3a4b7a9d5898e4d059c34a', 'request_id': 'req-2c91fa95-684e-4323-a5c4-d52be5e92391'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:15.857093 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] The token cache is being invalidate because project b2dbeb905d3a4b7a9d5898e4d059c34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:15.857371 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:15.857987 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:15.859529 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1464/2882] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:35:15 2022] DELETE /identity/v3/projects/b2dbeb905d3a4b7a9d5898e4d059c34a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:15.863647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:15.873379 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f644b-59a1-40ff-b56c-71958d4d7859 service neutron] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:15.929194 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:15.930060 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:15.930367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:15.930660 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] PATH_INFO: `/v3/users/1d362dcef6164e44930b8f88bf10cf50` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:15.931843 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d362dcef6164e44930b8f88bf10cf50)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:15.933782 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:16.190695 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d362dcef6164e44930b8f88bf10cf50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.202972 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d362dcef6164e44930b8f88bf10cf50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.204842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d362dcef6164e44930b8f88bf10cf50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.204842 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d362dcef6164e44930b8f88bf10cf50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.211975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d362dcef6164e44930b8f88bf10cf50'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.308677 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1419/2883] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:35:15 2022] DELETE /identity/v3/users/1d362dcef6164e44930b8f88bf10cf50 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:16.733265 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:16.734705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:16.748430 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91fa95-684e-4323-a5c4-d52be5e92391 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:16.768710 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:16.806491 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:16.807349 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:16.807628 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:16.807906 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] PATH_INFO: `/v3/projects/e10fd4ea4d63440ea4fdb9c5215669bb` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:16.809103 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10fd4ea4d63440ea4fdb9c5215669bb)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:16.810981 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:16.914122 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10fd4ea4d63440ea4fdb9c5215669bb', 'request_id': 'req-761964e4-43a4-45b4-9305-65aef25a31c0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.965888 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10fd4ea4d63440ea4fdb9c5215669bb', 'request_id': 'req-761964e4-43a4-45b4-9305-65aef25a31c0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.972193 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10fd4ea4d63440ea4fdb9c5215669bb', 'request_id': 'req-761964e4-43a4-45b4-9305-65aef25a31c0'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.983783 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] The token cache is being invalidate because project e10fd4ea4d63440ea4fdb9c5215669bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:16.984066 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.984724 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:16.986262 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1465/2884] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:35:16 2022] DELETE /identity/v3/projects/e10fd4ea4d63440ea4fdb9c5215669bb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:16.990975 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:16.996621 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:17.005103 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019784-f2b3-48eb-9cb5-dc64765eb0c6 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:17.041011 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:17.064800 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:17.065670 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:17.065948 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:17.066221 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] PATH_INFO: `/v3/users/ebd9e5c8702549fcbd7552d01b8b5645` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:17.067425 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd9e5c8702549fcbd7552d01b8b5645)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:17.069564 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:17.288279 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd9e5c8702549fcbd7552d01b8b5645'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:17.299671 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd9e5c8702549fcbd7552d01b8b5645'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:17.300366 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd9e5c8702549fcbd7552d01b8b5645'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:17.300956 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd9e5c8702549fcbd7552d01b8b5645'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:17.308530 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-737f35a8-e2c9-4105-8c21-f75a1b9d0ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd9e5c8702549fcbd7552d01b8b5645'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:17.406808 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1420/2885] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:35:16 2022] DELETE /identity/v3/users/ebd9e5c8702549fcbd7552d01b8b5645 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:17.819678 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:17.821295 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:17.834664 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761964e4-43a4-45b4-9305-65aef25a31c0 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:17.889696 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:17.890551 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:17.890832 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:17.891104 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] PATH_INFO: `/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:17.892305 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61626a3b2ca94d5e92ce7f66f481b21d)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:17.894184 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.034937 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61626a3b2ca94d5e92ce7f66f481b21d', 'request_id': 'req-11f96fa8-a303-4b1e-957d-7b48f82a86a5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:18.038681 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:18.171625 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61626a3b2ca94d5e92ce7f66f481b21d', 'request_id': 'req-11f96fa8-a303-4b1e-957d-7b48f82a86a5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:18.178636 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61626a3b2ca94d5e92ce7f66f481b21d', 'request_id': 'req-11f96fa8-a303-4b1e-957d-7b48f82a86a5'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:18.189025 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] The token cache is being invalidate because project 61626a3b2ca94d5e92ce7f66f481b21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:18.189309 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:18.189919 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-11f96fa8-a303-4b1e-957d-7b48f82a86a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:18.191438 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1466/2886] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:35:17 2022] DELETE /identity/v3/projects/61626a3b2ca94d5e92ce7f66f481b21d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:18.197908 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.198405 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.198504 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.216511 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:18.217685 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:18.275784 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1421/2887] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:18.285385 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.285669 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.285942 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.304507 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:18.305687 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:18.313381 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1467/2888] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:18.317475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.328354 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb370-f7ba-4527-98e4-87682fc84fd0 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.333024 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.333700 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.333983 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.334958 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.335681 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:35:18.335989 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.337669 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.349449 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1422/2889] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 19 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:35:18.353812 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.362917 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b240e-0a4c-495e-8ca1-828d6648d2ea None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.368010 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.368690 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.368970 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.369241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.369915 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.371787 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.475908 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1468/2890] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 19 12:35:18 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:18.479970 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.490496 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bcdf-edce-4b0f-85bc-84fc8e276d54 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.528255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:18.543988 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.544674 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.544965 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.545255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.545943 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.547835 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.691647 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1423/2891] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 19 12:35:18 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:35:18.695712 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.705984 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143640f-e110-485e-b841-5e76bce432c3 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.710747 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.711396 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.711676 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.711955 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.712705 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.714317 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.724616 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1469/2892] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:18.728696 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.738321 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d777-4da4-4858-8978-d5f5154bdfc4 admin admin] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.744475 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.745360 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.745641 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.745973 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.746693 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.748414 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c4bf-c808-4b2b-85ca-f6e692615c6c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.760778 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1424/2893] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 19 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:35:18.765172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:18.775078 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8a03-0ae6-4705-b928-349de6fc7d67 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:18.779611 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:18.780558 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.780791 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.781064 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] PATH_INFO: `/v3/projects/cdd21b1d46eb476a96da3f4805b3200c/users/4c2437e2ac3b4d06a2de90d25dc790f6/roles/b736f5f03a2c4dcb85ab86db9885a955` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.795968 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd21b1d46eb476a96da3f4805b3200c, user_id=4c2437e2ac3b4d06a2de90d25dc790f6, role_id=b736f5f03a2c4dcb85ab86db9885a955)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:18.798606 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:18.920096 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1470/2894] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 19 12:35:18 2022] PUT /identity/v3/projects/cdd21b1d46eb476a96da3f4805b3200c/users/4c2437e2ac3b4d06a2de90d25dc790f6/roles/b736f5f03a2c4dcb85ab86db9885a955 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:18.931686 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017078f5-9b7c-4d44-b943-0303a03c3744 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:18.931998 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017078f5-9b7c-4d44-b943-0303a03c3744 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:18.942082 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017078f5-9b7c-4d44-b943-0303a03c3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:18.959687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-017078f5-9b7c-4d44-b943-0303a03c3744 None None] MFA Rules not processed for user `4c2437e2ac3b4d06a2de90d25dc790f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:18.960914 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-017078f5-9b7c-4d44-b943-0303a03c3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:19.024252 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1425/2895] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:19.035264 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:19.037537 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:19.093824 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615d34b-b997-4052-9989-5d4ee25c6013 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:19.097581 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab02d4594794adca8c3188d0a9d3d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:19.099568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:19.099568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:19.099568 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:19.108189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:19.109663 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:19.118642 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1471/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:20.907188 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:20.907687 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:20.907783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:20.924668 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] MFA Rules not processed for user `4c2437e2ac3b4d06a2de90d25dc790f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:20.925844 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:20.932639 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1426/2897] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:26.440620 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:26.442145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:26.501315 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4dc4-1320-4b78-a069-d19496a64e0e service cinder] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:26.505657 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:26.506187 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:26.506461 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:26.506730 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:26.508539 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:26.518253 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:26.519770 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6acb19-d853-4a76-85f3-f76cada18dc3 service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:26.527948 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1472/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:27.447818 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:27.449315 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:27.531491 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1444104-d0f4-4669-894b-ed143fd15013 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:27.537892 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9f3e7fa6b24e17973f23be244ab083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:27.538552 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:27.538837 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:27.539110 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:27.541021 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:27.555428 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:27.557130 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:27.569071 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1427/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:36.524092 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=89,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:37.563658 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:38.450701 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088cd3e-a168-4ab8-828f-fd6abdfd7002 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:38.451165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088cd3e-a168-4ab8-828f-fd6abdfd7002 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:38.451267 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088cd3e-a168-4ab8-828f-fd6abdfd7002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:38.508635 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-6088cd3e-a168-4ab8-828f-fd6abdfd7002 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:38.509827 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-6088cd3e-a168-4ab8-828f-fd6abdfd7002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:38.573261 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1473/2900] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:38.746783 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:38.748179 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:38.835300 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea6b4-bd00-42ae-ac56-fce2cfef8646 service nova] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:38.840306 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:38.840971 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:38.841255 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:38.841529 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:38.850013 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:38.851623 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:38.859561 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1428/2901] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:35:39.709550 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21702-22b9-416d-a7f2-158a35d02e68 None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:39.714565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21702-22b9-416d-a7f2-158a35d02e68 None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:39.714565 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21702-22b9-416d-a7f2-158a35d02e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:39.727825 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-88a21702-22b9-416d-a7f2-158a35d02e68 None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:39.729741 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-88a21702-22b9-416d-a7f2-158a35d02e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:39.737356 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1474/2902] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:35:39.749527 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:39.761226 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244c89-cd24-4bda-b5b4-5fbf6fc4c45e service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:39.766227 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:39.766876 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:39.767157 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:39.767461 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:39.776415 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:39.777984 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:39.787128 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1429/2903] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:35:40.444804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256f5b-887d-40c1-9f44-90ea69f12feb None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:40.449241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256f5b-887d-40c1-9f44-90ea69f12feb None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:40.449241 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256f5b-887d-40c1-9f44-90ea69f12feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:40.463230 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-1b256f5b-887d-40c1-9f44-90ea69f12feb None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:40.464445 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-1b256f5b-887d-40c1-9f44-90ea69f12feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:40.471339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1475/2904] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 19 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:40.483532 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:40.494688 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc1903-3e86-4367-b63a-9c7df13a684b service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:40.499558 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:40.500181 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:40.500484 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:40.500754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:40.508744 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:40.510296 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:40.518112 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1430/2905] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:35:41.187402 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] REQUEST_METHOD: `POST` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:41.187850 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:41.187966 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:41.206141 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.auth.core [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] MFA Rules not processed for user `5a997ab3c1b44133ba74d2f514cf2979`. Rule list: `[]` (Enabled: `True`). {{(pid=80601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:41.207330 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:41.215564 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1476/2906] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 19 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:41.227613 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:41.238238 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ffb0-1dd6-4ddf-82df-ce69d5506b35 service swift] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:41.243291 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c9fc3f5c10a4b47bca065dcd516fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:41.243921 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] REQUEST_METHOD: `GET` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:41.244224 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:41.244505 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:41.252506 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:41.254066 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb793c-6941-41d9-8708-bf7be3005d1e service swift] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:41.262450 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1431/2907] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 19 12:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:35:43.814702 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:43.877627 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae306-6957-4443-8838-dc7b9ddbae2d None None] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:43.882694 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:43.883543 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:43.883821 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:43.884090 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] PATH_INFO: `/v3/users/4c2437e2ac3b4d06a2de90d25dc790f6` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:43.885279 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2437e2ac3b4d06a2de90d25dc790f6)` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:43.887165 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:44.047000 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:44.048502 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2437e2ac3b4d06a2de90d25dc790f6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.060599 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2437e2ac3b4d06a2de90d25dc790f6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.067145 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2437e2ac3b4d06a2de90d25dc790f6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.067804 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2437e2ac3b4d06a2de90d25dc790f6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.068417 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.notifications [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2437e2ac3b4d06a2de90d25dc790f6'} {{(pid=80601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.170788 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1477/2908] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 19 12:35:43 2022] DELETE /identity/v3/users/4c2437e2ac3b4d06a2de90d25dc790f6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:44.175338 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] REQUEST_METHOD: `POST` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:44.175905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:44.175905 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:44.193618 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.auth.core [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] MFA Rules not processed for user `d15f9567be7a45d68d8b1259f6bb9e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:35:44.194804 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:44.252063 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1432/2909] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 19 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:35:44.261576 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:44.262978 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:44.323714 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362e42e-1f9e-4e85-b307-99669ad187d5 admin admin] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:44.327607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa0ee1eea094fcd8bdc87fcc630fb6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:44.328324 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:44.328604 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:44.328872 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:44.339350 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:44.341189 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:44.351063 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1478/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:44.635738 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] Authenticating user token {{(pid=80602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:44.637182 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.fernet_utils [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:44.649861 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d569e8-5bf1-4eaf-b128-1a85452cfe20 None None] Validating token access rules against request {{(pid=80602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:44.654487 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15f9567be7a45d68d8b1259f6bb9e07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3e54b6083e4b39ac3a5ef049d34d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:44.655469 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:44.655754 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:44.656026 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] PATH_INFO: `/v3/projects/cdd21b1d46eb476a96da3f4805b3200c` {{(pid=80602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:44.657270 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd21b1d46eb476a96da3f4805b3200c)` {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:44.659185 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] RBAC: Authorization granted {{(pid=80602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:44.744367 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:44.760587 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd21b1d46eb476a96da3f4805b3200c', 'request_id': 'req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.839899 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd21b1d46eb476a96da3f4805b3200c', 'request_id': 'req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.846352 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd21b1d46eb476a96da3f4805b3200c', 'request_id': 'req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c'} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.856836 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] The token cache is being invalidate because project cdd21b1d46eb476a96da3f4805b3200c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:44.857165 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.857787 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG keystone.notifications [None req-f7e7e40d-15c0-4356-a52a-5f0d7e286a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:44.859324 dv-cinder-778193-27-smb devstack@keystone.service[80602]: [pid: 80602|app: 0|req: 1433/2911] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 19 12:35:44 2022] DELETE /identity/v3/projects/cdd21b1d46eb476a96da3f4805b3200c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:54.346095 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:54.853775 dv-cinder-778193-27-smb devstack@keystone.service[80602]: DEBUG dbcounter [-] [80602] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:30.476172 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] Authenticating user token {{(pid=80601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:37:30.477607 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:30.545163 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba1e6-5d68-4824-94a1-227605366cef service neutron] Validating token access rules against request {{(pid=80601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:37:30.603339 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56883af2bfba4a12b2642987506a187e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46296c78ea9d4d13ba0d84ceca2fc9a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:37:30.604011 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] REQUEST_METHOD: `GET` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:37:30.604320 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] SCRIPT_NAME: `/identity` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:37:30.604597 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:37:30.606378 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.fernet_utils [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:30.617644 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:37:30.619310 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6aa7-8baa-49c9-bd5b-ed70aa2fcd85 service placement] RBAC: Authorization granted {{(pid=80601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:37:30.629192 dv-cinder-778193-27-smb devstack@keystone.service[80601]: [pid: 80601|app: 0|req: 1479/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 19 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:37:40.625030 dv-cinder-778193-27-smb devstack@keystone.service[80601]: DEBUG dbcounter [-] [80601] Writing DB stats keystone:SELECT=58 {{(pid=80601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}